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SECTiUh  i 


INTRODUCTION 


The  purpose  of  the  Aovanceo  Computer  image  Generation  (.CIG) 
Visual/Sensor  Simulation  {MSS)  study  contract  was  to  investigate, 
oeveiop,  ana  evaluate  various  CIG  techniques  to  overcome  the 
qualitative  ana  quantitative  limitations  of  current  CIG  images 
proaucea  oy  euge-Pasea  systems.  The  stuoy  was  to  conciuoe  with  an 
integration  of  tnese  techniques  into  a  system  concept.  This  final 
report  for  tne  stuoy  phase  of  tne  contract  aiscusses  the 
investigation,  oeveiopment,  and  evaluation  which  lea  to  the  system 
concept. 

Tms  program  ±s  envisioned  as  part  of  a  total  system  aevelopment  where 
tne  next  pnase  woula  consist  of  a  software  simulation/valiaation 
fuiloweo  oy  a  fabrication  ana  testing  of  prototype  haroware.  The 
finoings  of  the  report,  nowever,  are  directly  applicable  to  many 
simulators  ana  could  be  incorporated  into  other  simulation  systems. 
Empnasis  on  low-ievel  flying  ana  the  need  to  incorporate  tracking  for 
target  detection,  recognition,  ana  iaentification  give  rise  to  new 
requirements  for  realism  in  these  simulations.  Hue  ano  saturation  are 
important  in  long-range  views.  At  medium  and  short  ranges,  texture 
gradients  proviae  the  aepth  cues  neeaea  for  realistic  simulation. 

This  has  been  the  primary  basis  for  the  system  concept  chosen  for  the 
stuoy. 

The  criteria  used  in  choosing  the  techniques  have  been  the 
requirements  for: 

a  Capability  to  proviae  more  realism  than  current  techniques 

o  Potential  for  greater  efficiency  than  current  techniques 

o  Compatibility  with  other  techniques  from  a  system  point  of 
view 

o  Reasonable  architecture  for  using  today's  technology 

o  Possibilities  for  reauction  in  cost  using  tomorrow's 
technology 

Tne  major  areas  of  concern  in  CIG  for  visual/sensor  simulation  are: 
o  Surface  representation 

o  Texture  representation 

o  Intensity  computation 

o  Image  generation 

o  Embedded  oojects 
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T nc  metnoo  useu  for  perspective  views  of  a  surface  is  tnat  of  us^ng 
uj-CuDic  suouivision  originaiiy  proposeo  cy  Catmull  (.1574;.  Latnuii's 
■netfiou  is  a  fast  recursive  sucoivision  of  a  paten  into  smaller  ano 
smarrer  suupatcnes  untii  eacn  suopaten  is  small  enougn  to  ue 
uispiayeo;  that  is,  pixel  size. 

The  texture  representation  in  this  stuay  is  oasea  on  fractals  wnicn 
are  especially  suitaDie  for  training  in  iow-level  flight  ana  for 
air-to-surface  missions.  The  implementation  of  fractal  texturing 
aliows  computing  the  surface  to  aroitrary  levels  of  oetail  without 
increasing  the  aata  Dase.  Therefore,  the  simulation  woula  result  in  a 
continuous  change  of  oetail  ana  texture  aensity  for  all  flight  paths. 

Tne  intensity  calculation  is  basea  on  color — hue,  saturation,  ana 
vaiue  I.HSV) — for  the  visiole.  The  hue,  saturation,  ano  value  are 
converteo  to  rea,  green,  ana  blue  (.RGB;  for  aisplay  purposes.  For  low 
right  level  TV  (LLLTV;  ana  forwara-iookinq  infrareo  (FLIR)  black  ano 
wnite  will  be  used  (same  as  in  the  actual  sensor).  There  are  many 
more  sensor  requirements,  however,  when  simulating.  The  parameters  ' 
which  affect  the  value  or  intensity  in  the  display  must  be  determined 
prior  to  the  actual  simulation. 

The  image  generation  is  based  on  a  z-Duffer  concept.  Those  surfaces 
wmch  are  closer  occluoe  all  other  surfaces.  This  is  a  simple 
solution  to  the  hiaaen  surface  problem.  Computing  requirements 
increase  linearly  with  scene  complexity.  Also,  aifferent  atmospheric 
effects  are  possible  since  the  aistance  to  each  pixel  is  known. 

Moving  targets  ana  objects  within  the  scene  can  be  generatea 
simultaneously  in  this  approach. 

This  report  covers  these  aspects  of  the  technical  effort  of  the  study 
phase  for  AVSS.  The  system  concept  (Section  2)  is  presentea  first, 
followed  by  the  detailea  investigation  (Section  3).  Some 
implementation  consiaerations  are  oiscussea  in  Section  4.  The 
conclusion  (Section  b)  preceaes  a  list  of  references  usea  in  the 
investigation  for  this  report.  Appenaixes  A  through  E  are  incluaea  to 
provide  aaoitional  oetail  about  some  of  the  concepts  investigatea. 
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SEul  ION 


SYSTEM  CONCEPT 


The  general  system  concept  is  presentea  in  this  section.  In  Section 
3,  more  aetail  is  given  where  appropriate  to  complete  the  system 
concept. 

Tne  system  concept  oevelopea  for  AVSS  is  shown  in  Figure  1.  The 
system  consists  of  both  off-line  (computer-generatea)  preparation  ano 
on-line  or  real-time  generation.  Tne  off-line  preparation  consists  of 
ootaining  mission  inputs  from  the  Defense  Mapping  Agency  (.DMA;  aata 
base  as  well  as  aaoitional  mission  information  such  as  time  of  oay  ano 
sensor.  Once  this  information  is  obtaineo,  the  appropriate  files  are 
mergeo  into  one  large  file  for  further  processing.  Texture  labels  are 
generateo  for  each  of  the  terrain  squares.  Note  that  the  texture 
labels  ana  register  squares  are  mission-inaependent,  ano  can  be 
generated  any  time  prior  to  the  mission.  Next  shadows  are  generated 
ano  storea  on  the  aisc  arives.  Finally,  cultural  features  such  as 
houses,  bridges,  ana  roaGs  are  adoea. 

The  on-line  generation  consists  of  determining  the  initial  starting 
point  and  ioaaing  the  fast  fiela-of-view  (FOV)  memory.  Once  this  is 
oone,  only  new  FOV  information  must  be  transmitted  between  the  on-line 
storage  ana  the  fast  FOV  memory.  A  perspective  transformation  then 
transforms  the  oata  from  object  space  to  image  space.  This  requires  a 
test  of  the  patch  size  to  see  whether  it  is  also  pixel  size.  If  it  is 
not,  it  is  subaividea  until  it  is  equal  to  a  pixel  size. 

Subdivision  involves  more  than  just  subdividing  surface  polygons  down 
to  pixel  size.  The  fractal  information  being  used  for  intensity 
calculation  must  be  subdivided  and  the  surface  normals  for  each 
iubpatch  must  also  be  calculated. 

Intensity  calculation  must  now  be  done  for  every  pixel  within  the 
whole  screen.  However,  some  pixels  may  be  overridden  because  they  are 
hidden;  it  is  this  occultation  that  is  of  concern.  As  each  pixel's 
intensity  is  calculated,  the  z-buffer  information  (the  distance 
information)  is  checked  to  see  whether  it  is  closer  to  the  pilot  than 
what  is  already  contained  within  the  memory.  If  the  z-buffer 
information  is  closer  to  the  pilot's  position,  it  will  overlay  the 
memory  data.  Once  the  intensity  is  calculated  an  anti-alias  procedure 
removes  the  jagged  edges  in  the  scene.  Once  anti-aliased,  the  data  is 
dumped  into  a  frame  buffer  and  displayed.  There  should  be  two  frame 
buffers  so  that  one  can  be  filled  during  the  time  that  the  second  is 
being  displayed. 

A  1024  x  1024  display  and  a  60-Hz  refresh  rate  are  ambitious 
assumptions;  each  of  the  blocks  just  discussed  will  be  examined  in 
more  detail.  - 
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Figure  1.  AVSS  system  concept. 


The  following  mission  information  is  assumed  to  be  typical  of  the  type 
to  oe  given: 

o  Sensor  type:  visual,  infrared  (IR),  or  LLLTV 

o  All  the  weather  conditions  for  the  duration  of  the  entire 
flight.  (Assuming  one  constant  set  of  weather  conditions.) 

o  The  sun  or  the  moon  position.  (For  the  entire  duration  of 
the  mission  the  sun  and  moon  position  are  considered 
constant. ) 

o  Albedos  (reflectivities)  and  emissivity  information 

o  Special  effects 

o  Additional  cultural  objects 

o  Fractal  look-up  tables  (LUTs)  to  be  designated  for  texture, 
texture  borders,  and  shadow  borders. 

o  The  approximate  flight  path  which  gives  us  the  required 
inputs  for  the  DMA  data  base  size  and  location. 

The  first  job  is  to  select  the  appropriate  DMA  data  files,  which 
consist  of  terrain  elevations  as  well  as  cultural  data.  These  data 
are  then  merged  so  that  all  the  elevations  are  in  one  file  and  the 
cultural  data  are  coordinated  with  that  same  file.  This  particular 
operation  of  reading  the  tapes  could  require  several  hours  because  up 
to  10  tapes  may  have  to  be  searched  to  obtain  all  the  required  data 
for  an  assumed  800  km  x  48  km  flight  path  area.  These  elevation  and 
cultural  data  require  about  10  megabytes  (Mbyte)  for  storage. 

The  next  procedure  assigns  the  textures  in  the  surface  material 
categories  to  the  DMA  data  base  and  then  locates  the  particular 
elevations  in  that  texture  area.  The  first  step  is  to  construct  a 
chain  code  and  then  to  locate  and  designate  the  texture  labels. 

The  register  square  process  computes  the  register  square  values  for 
each  patch  corner.  To  do  this,  16  elevations  are  placed  in  a  A  x  4 
matrix  to  get  the  register  square  values.  The  method  used  is  a 
bicubic  spline  which  allows  for  no  discontinuity  between  patches.  The 
time  required  for  this  particular  operation  is  about  four  hours  for 
the  entire  mission  data  base. 

Next,  shadows  are  assigned  so  that  each  terrain  square  has  a  shadow 
label.  The  procedure  is  first  to  determine  the  pixel  dimensions  that 
are  contingent  on  the  terrain  elevation,  then  to  determine  the  sun 
space  FOV,  and  finally  to  determine  the  z  values  of  the  distance 
information.  Now  those  areas  that  are  shaded  can  be  determined  and 
labeled.  This  is  similar  to  the  register  square  process  and  will  take 
approximately  13  hours. 


Finally,  tne  cultural  features  desired  for  a  particular  mission  are 
auaea.  These  features  induce  houses,  trees,  roaos,  railroaos, 
factories,  iignts,  moving  oojects,  etc. 

After  all  these  off-iine  operations,  the  resuit  is  the  mission  oata 
case.  It  is  a  collection  of  all  the  regional  oata  blocks  (or  patches) 
containeo  in  tne  mission  oata  base.  The  regional  oata  blocks  contain 
register  squares  defining  the  bicubic  elevations,  a  pointer  to  a  list 
of  the  unique  features  which  apply  to  the  patch,  a  pointer  for  the 
synthetic  texture,  a  aefinition  ana  list  of  objects,  ana  a  surface 
normal.  The  oata  blocks  shoula  be  organizeo  as  a  quad  tree  to 
facilitate  finoing  the  patches  for  a  given  frame. 

Tne  next  step  involves  the  real-time  system  requirements  for  AVSS. 
Initially,  some  information  about  the  starting  location  of  the 
aircraft  must  oe  assumea,  ana  these  oata  must  be  transferred  from  the 
on-nne  storage  to  the  fast  FQV  memory.  As  the  FOV  changes,  only  the 
resulting  new  oata  must  be  transferred  from  the  on-line  storage  to  the 
fast  FGV  memory.  The  oata  storage  for  the  fast  FOV  memory  is  expectea 
to  oe  about  12  Mbytes  for  a  full  360°  FOV.  This  is  based  on  having 
approximately  368  bits  for  eacn  patch,  consisting  of  the  vector 
normal,  xy  location,  size,  texture,  shaaow,  ana  register  square  oata. 

The  next  three  ulacks — transformation,  test,  and  suboivioe — are 
generally  treatea  as  one  unit.  A  patch  is  put  into  the  perspective 
transformation  ana  transferred  from  object  space  to  image  space.  The 
patch  is  then  tested  to  see  whether  it  is  of  pixel  size.  If  not,  it 
must  be  subdivided  in  object  space  and  undergo  another  perspective 
transformation  into  image  space,  ana  then  be  tested  again.  This 
proceaure  involves  a  large  number  of  perspective  transformations  per 
frame.  Later  sections  wiil  describe  the  number  of  perspective 
transformations  ana  how  the  perspective  ana  subdivision  processes  are 
performeo.  As  discussed  previously,  subdivision  consists  of  three 
parts:  bicubic,  fractal,  and  vector  normal. 

At  the  ena  of  subdivision,  approximately  five  million  patches  will 
require  an  intensity  calculation.  Each  must  have  vector  normalization 
ana  must  be  transformed  from  HSV  into  the  RGB  space  of  the  Display. 

Only  those  polygons  which  are  not  hiaaen  will  go  through  the 
anti-aliasing;  hence,  the  occultation  is  reaily  a  test  to  determine 
wnich  parts  are  hidden.  The  purpose  of  anti-aliasing  is  to  eliminate 
aliasing  artifacts  caused  by  improper  sampling.  Our  procedure  is  to 
have  a  five-point  average  pixel  that  uses  three  points  per  frame. 

This  requires  three  times  the  number  of  pixels  in  the  frame  operations. 

Tne  frame  buffer  ana  display  can  be  considered  as  a  unit.  The  frame 
ouffer  feeds  the  aisplay;  however,  it  gets  the  data  from  the  rest  of 
the  hardware.  Two  buffers  are  usea  so  that  one  can  be  inputting  data 
at  the  same  time  that  the  other  is  aisplay ing.  The  initial  concept 
involves  22  Mbytes  of  high-speed  frame  buffer  memory,  for  both 
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intensity  and  z-buffer  information.  How  this  might  be  eliminated 
later  is  discussed  in  succeeding  sections.  The  intensity  buffer  can 
be  preset  to  a  given  condition  at  the  start  of  each  frame.  When  the 
aesignateo  mission  area  has  been  ventured  outside  of  during 
simulation,  this  preset  condition  will  then  occur. 


iELTIGN  3 


DETAILED  INVESTIGATION 


This  section  of  the  report  presents  a  detailed  investigation  of  the 
AVSS  techniques.  Included  is  a  discussion  of  some  alternatives 
considerea,  but  most  of  the  section  focuses  on  the  preferred  approach. 

3.1  OPERATIONAL  REQUIREMENTS 

Eight  areas  are  to  be  consiaerea  under  the  category  of  operational 
requirements : 

1 .  upaate  rate 

2.  Transport  oelay 

3.  Perspective 

4.  Viewpoint  maneuverability 

5.  Fiela  of  view 

6.  Resolution 

7.  Image  mapping 
S.  Occultation 

3.1.1  Upaate  Rate 

In  this  study  of  the  AVSS  system,  the  update  rate  has  been  a  fixed 
parameter  which  determines  the  complexity  of  the  system  before  the 
frame  buffer.  The  update  has  been  chosen  to  be  1/60  second  per 
frame;  a  frame  is  defined  as  1024  pixels  per  line  and  1024  lines  per 
frame. 

Even  tnough  a  i/30-second  frame  rate  is  acceptable  for  normal 
television  viaeo,  some  aliasing  artifacts  can  still  be  seen,  for 
example,  a  wheel  turning  backwards  on  a  stagecoach.  Note  that  neither 
more  samples  per  line,  nor  an  increase  in  frame  rate,  necessarily 
eliminate  this  phenomenon.  Increasing  the  frame  rate  simply  reauces 
temporal  aliasing  artifacts.  In  general,  the  upaate  rate  is 
sufficient  to  allow  the  viewer  to  perceive  continuous  motion  ana  to 
interact  with  the  simulatea  environment. 

3.1.2  Transport  Delay 

Transport  oelay  is  aefined  as  the  interval  from  the  time  the  aircraft 
state  is  calculated  to  the  completion  of  the  image  computeo  for  that 
state.  The  transport  oelay  is  the  sum  of  several  delays  through  the 
system: 

To  =  Transform  +  ttest  +  tsub  +  tint  +  taa  +  tfb 
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wnere 

=  transport  delay 

=  delay  through  the  perspective  transformation 

=  delay  through  the  test  before  subdivision 

=  delay  through  the  patch  subdivision 

=  delay  through  the  intensity  calculation  and 
z-buffer  test 

TAA  =  delay  through  the  anti-aliasing 

tFB  =  delay  through  the  frame  buffer 

Tne  approach  taken  here  to  estimate  the  delay  was  to  assume  fully 
parallel  computation  ana  to  use  pipeline  architecture  iaeas  for  the 
inaivioual  clocks  shown  in  the  system  concept.  The  throughput  is 
oetermmeo  by  the  iowest-speeo  aevice  in  c.he  pipeline  ana  should  not 
be  confused  with  the  transport  delay  calculations.  Each  of  the 
following  estimates  is  basea  on  these  assumptions. 

The  first  portion  of  the  transport  delay  involves  the  time  required  to 
ao  the  perspective  transform  from  c  space  to  image  space.  This 
projection  requires  five  stages,  Shown  in  Figure  2.  (Note:  Many 
of  the  figures  anc  aiscussions  are  basea  on  Solano,  Voth,  and 
Narenara;  1981).  If  200  nanoseconds  (nsec)  per  stage  is  assumed, 
then 

T TRANSFORM  *1*0  microseconds  (psec) 

It  should  be  noted  that  the  200  nsec  is  really  a  clock  time  determined 
by  the  slowest  element  in  the  pipeline;  in  this  case,  the  multiply, 
it  may  not  be  necessary  to  use  200  nsec  for  ail  stages. 

The  aeiay  through  the  test  consists  of  a  box  griopoint  test,  which 
uetermines  whether  the  patch  should  be  further  subdivided  or  passed 
through  to  the  intensity  calculation.  A  box  approximation  test  is 
usea;  the  implementation  is  shown  in  Figures  3  ana  4.  There  are  a 
total  of  eight  stages  at  200  nsec  per  stage,  therefore, 

TTEST  s  1.6  psec 

The  subdivision  process  involves  a  total  delay  of  four  stages  (Figures 
3  ana  6);  the  letters  shown  in  the  figures  refer  to  the  values  in  the 
register  squares  before  ana  after  subdivision.  There  is,  however,  a 
potential  bottleneck  at  this  location.  When  the  subdivision  occurs, 
four  new  sets  of  register  square  values  are  created.  Unless  one  has  a 
means  of  immediately  continuing  with  four  parallel  channels,  the  data 
must  be  stored  as  shown  in  Figure  7.  The  delay  through  the  memory 
must  be  included  in  the  transport  aeiay.  Figure  8  presents  a  possible 
parallel  structure  for  the  total  process  of  perspective 
transformation,  testing,  and  subdivision. 


To 

ttransform 

ttest 

TSU8 

tint 
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*R  DENOTES  REGISTER 


Figure  2.  Pipeline  hardware  block  oiagram  for 
perspective  projection  stage. 


NO  GRID  (STOP  SEARCHING 
POINT  THIS  BRANCH) 


ONE  GRID  (GO  TO  NEXT 
POINT  MODE  IN  TREE) 


ONE  GRID  (DISPLAY) 
POINT 


‘LOGICAL  "OR"  OPERATION 


Figure  3.  Grid  point  test. 


I 
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NOTE:  A  •  Xqq  OR  Y00,  B  ■  X01  OR  Yg,.  ETC. 

Figuxe  4.  Maximum/minimum  circuit  as  part  of  gno  point  test. 
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SUBDIVIDE  PATCH  (PARTI) 


NOTE:  SUBSCRIPT  IDENTIFIES  DNE 
OF  FOUR  NEW  REGISTER 
SQUARE  VALUES  IN  ONE 
OF  NINE  NEW  REGISTER 
SQUARES.  DENOTED  BY  CIRCLED 
NUMBER 


Figure  5.  Subaiviae  pipeline,  Part  1. 


SUBDIVIDE  PATCH  (PART  2) 


'  -£EHjD— ED— ED-Q, 

•  — F~l — 0 — El — ED~©i 
1  ttCiHZD— ED-ED-© 

1  nS — ED — ED — ED-© 

1  “dDD— ED— 0— ED~  © 

"•—{ZD — IZD — 0] — CDIh^, 

*  tTH — ED — ED — E~t~Q; 
"HEP — ED — ED — GD~©!' 
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P  - 1  R 

+  1 


Figure  6.  Subaiviae  pipeline,  Part  2 
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Figure  7.  Subdivision  piocess  involving  memory. 


STAGES  1  1  1  4  4  4  1  6  16  16  64  64  64  (64  »  4) 


P  PERSPECTIVE  TRANSFORMATION 
T  TESTING 
S  SUBDIVISION 
M  MEMORY 

Figuxe  6.  Perspective  transformation  involving  loop  process. 
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At  the  enu  of  eacn  test,  data  will  either  go  to  the  intensity 
calculation  or  requne  tuitner  suoGivision.  The  numDer  of  suDQivision 
is  snown  to  ce  aoout  i.7  x  ±0°  in  Appenaix  E,  with  the  total  numDer 
of  patcnes  to  oe  four  times  this,  or  0.6  x  1G0.  For  the  worst  case 
it  is  assumed  that  ail  tms  would  nave  to  De  stored  in  the  memory 
cnanneis.  Tnen  tne  memory  required  for  the  cnannels  snown  is: 

6.8  x  10°/ 64  =  106K/cnannei 

Again  assuming  200  nsec  for  the  oelay  or  clock  cycle,  the  result  is 
Q.ux.i  seconus  of  oelay,  or  2i  miliiseconos  (msec;. 

Note  nere  tnat  numoer  of  channels  of  the  perspective  transformation, 
test,  ana  subdivision  are  each  85  cnanneis.  in  Section  4, 
implementation  Considerations,  it  is  estimated  that  approximately  80 
cnanneis  are  requireu  to  complete  the  entire  process  in  1/60  sec. 

in  tms  approacn,  transport  oelay  in  memory  has  oeen  sacrificed  for 
narcware.  It  is  possiDie,  for  instance,  to  have  256  stages  of 
additional  perspective  transform  ana  test.  The  aeiay  would  go  from 
miliiseconos  to  microseconds. 

From  tne  above  discussions: 

Tfifg  =  Al  msec 
anu 

tPRCC  =  0-0008  msec  (which  is  neglible) 
giving 

T5UB  =  21.0008  msec 

Note  in  Figure  8  that  the  output  of  the  First  In-First  Out  (FIFO) 
stack  or  memory  is  going  to  several  of  the  perspective 
transformations.  If  no  aata  are  going  into  the  perspective 
transformation  at  that  stage,  then  that  stage  and  testing  can  be  taken 
advantage  of.  The  analysis  above  has  not  considered  this 
specifically.  Also,  the  ramifications  of  ail  this  feedback  must  be 
taken  into  account  in  the  controlling.  It  may  be  that  the  memory 
couio  oe  allocateo  so  that  the  transport  oelay  coulo  be  reoucea 
further  with  no  increase  in  memory  but  with  more  control  circuitry. 

Tne  intensity  calculation  has  an  estimated  22  stages.  This  is  the 
estimated  complexity  for  tne  equations  given  in  the  tonal  computation 
section.  The  implementation  block  diagram  is  shown  in  Figure  9. 
Assuming  200  nsec  per  stage,  then: 

Tjnj  =4.4  ysec 

Tne  anti-aliasing  oelay  comes  from  four  stages  of  multiply,  two  aoos, 
ano  switch  between  frames,  hence: 

Taa  =  0-8  nsec 
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Tne  system  concept  approach  involves  switcniny  oetween  two  buffers, 
wnixe  one  frame  is  oeing  caicuiatea,  the  seconc  is  being  oispiayeo. 

The  maximum  ueiay  is  one  frame  time,  or 

Tpa  =  le.66o/  msec 
Tne  total  oeiay  time  is 

"'"TRANSPORT  =  0  •  CiOl  +  0.0016  +  21.0008  +  0.0044  +  0.0008  +  16.6667 
=  37.6733  msec 

One  item  not  inciuaeG  in  the  above  transport  aelay  is  the  time  to  get 
oata  from  tne  oisc  storage  to  the  fast  FOV  memory.  If  a  3eC°  fast 
FOV  memory  is  assumeo,  then  the  only  oata  to  be  aoaec  to  the  oata  base 
are  those  oata  corresponaing  to  the  distance  traveled  in  level 
fright.  It  is  shown  in  subsection  3.1.4  that  10  patches  neea  to  be 
transferreo  to  hign-speeo  memory.  These  i0  patches  are  at  the  extreme 
viewing  distance  so  that  when  the  new  patches  actually  appear,  they 
will  not  oe  noticeable.  The  primary  concern  is  tne  seek,  latency,  ana 
transmit  time  of  the  oisc;  that  is: 

tDISC  =  tSEEK  +  tLATENCY  +  tTRANSMIT 

For  a  typical  mass  storage  unit,  the  seek  time  is  30  msec  (average), 
tne  latency  time  is  8.33  msec  (average),  ana  for  10  patches  at  1.3 
Mbyte  transfer  rate,  the  transmit  time  is  0.3  msec,  which  gives: 

T0ISu  =  38.63  msec  (average) 

When  this  is  aaaea  to  the  previous  time,  the  total  transport  time  is: 
tTRANSPORT  =  76  msec 

This  time  can  be  considerably  decreased  by  getting  patches  only  every 
tenth  frame,  which  reduces  the  average  oisc  transport  oeiay  to  aDout 
4  msec  per  frame. 

3.1.3  Perspective 

In  oraer  to  preserve  perspective  valiaity  in  the  displayed  imagery, 
only  two  kinas  of  transformations  have  been  considered:  one  to  a  flat 
screen,  the  other  to  a  spherically  curvea  screen.  For  reasons 
aiscussea  in  subsection  3.1.7,  the  flat  screen  transformation  was 
chosen. 

Physically,  the  perspective  transformation  involves  three  coorainate 
systems  (.Figure  10):  1)  the  worio  coorGinate  system,  in  which  all 

off-iine  ana  on-line  terrain  ana  cultural  features  are  initially 
locateu,  1)  the  eye  cooroinate  system,  a  rectangular  orthogonal 
system  with  its  origin  at  the  pilots'  eye;  and  3)  the  screen 
cooroinate  systems,  representing  the  location  of  a  real  screen  or 
winaow  (.see  Newman  ano  Sproull,  1*79,  for  details). 
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WORLD  COORDINATE 
—  SYSTEM  ORIGIN 
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Figure  iO.  Coordinate  systems. 
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Tne  purpose  of  the  transformation  is  to  take  many  inaiviaual 
tnree-oimensionai  points  in  worlo  cooroinates  ana  transform  them  to 
screen  cooroinates  or,  equivalently,  screen  space.  The  eye  coorainate 
system  serves  as  an  intermeoiary  between  worlo  ano  screen  space.  The 
entire  transformation  of  an  arbitrary  point  from  worlo  eye  to  screen 
space  is  symbolically 

i  ,  Yyy ,  2^- )  (Xe>^g,Zg)  (Xg,Yg,ZgJ 

Thus,  two  transformations  are  involvea. 

The  first,  from  woria  to  eye  cooroinates,  involves  a  4  x  4  matrix 
multiply 

Ye  ^e  ^ )  =  Yw  ^w  Y 

wnere  V  is  a  4  x  4  matrix  concatenateo  from  five  component  matrixes: 

V  =  Vi  .  V2  .  V3  .  V4  .  V5 

The  five  component  matrixes  are 

1.  Translation  matrix: 

10  0  0 

Vi  =  0  10  0 

0  0  0  1 

-tx  -ty  -tZ  1 

2.  Right -hanaea  to  left-hanaea  matrix: 

-10  0  0 

V2  =  0  0-10 

0  10  0 

0  0  0  1 

3.  Rotate  by  0  arouna  ye  axis: 

cos  0  0 

v3  =  oi 

-sin  0  0 

0  0 

4.  Rotate  oy  $  arouno  xe  axis: 

1  0 

V4  =  0  cos 

0  sin  $ 

0  0 

5.  Rotate  by  \p  around  ze  axis: 

cos  'p  -sin  0  0 

V3  =  sin  >p  cos  0  0 

0  0  10 

0  0  0  1 


0  0 

-sin  <t>  0 

cos  0 

0  1 


sin  0  0 

0  0 

cos  0  0 

0  1 
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Mnyles  are  measured  clockwise  when  .Looking  along  the  rotation  axis 
toward  tne  origin.  The  multiplication  of  the  V  matrixes  gives  the 
Alj  values  presentea  in  Figure  2. 

Following  the  convention  of  many  computer  grapnics  people,  the  eye 
system  is  left-hanaeo,  Xe  to  the  right,  Ze  into  the  screen,  Ye 
up.  Because  tne  worio  system  is  right-hanaea,  the  matrix  V2  is 
empioyeo  to  change  from  right  to  left.  Of  course,  this  convention  may 
oe  ignorea  ana  V2  exclucieo  at  the  convenience  of  the  training  system 
aesigner. 

The  eye  coordinate  system  has  its  origin  at  tx,  ty,  te  in  the 
worio  system.  The  eye  axes  are  rotatea  through  three  angles:  9, 

1/,  ^yaw,  pitch,  ana  roil,  respectively).  Measuring  angles  as 
snown  in  Figure  10  with  world  ana  eye  axes  initially  aligned,  9, 

4> ,  ^  are  respectively  the  rotation  angles  aoout  the  Ye,  Xg, 

axes.  Note  that  these  rotations  must  occur  in  the  order  given  to 
make  sense,  that  is,  the  rotation  matrixes  do  not  commute. 


This  viewpoint  transformation  allows  presentation  of  the  proper  scene 
for  any  viewpoint  within  the  defined  aata  Oase.  The  viewpoint  can  be 
from  any  altitude,  including  on  the  surface.  The  attitude  (roll, 
pitch,  ana  yaw)  is  not  restricted.  The  sine  and  cosine  terms  must  be 
calculated,  however.  This  calculation  is  done  once  per  frame;  that 
is,  it  wili  not  change  during  the  frame  time. 


Tne  second  part  of  tne  perspective  transformation  (Xe  Ye  Ze)- 
(Xs  Y s  Zs)  is  given  Dy 

DXe 

Xs  =  3T  Vsx  +  Vcx 


— -  V  +  V 
SZe  sy  Vcy 


ana  Zs  may  oe  either 


S((Ze/D)  -  1) 

(1  -  Q/F )  (SZe/D)  01  Zs  =  Ze 


Xg  ana  Ys  are  orthogonal  screen  coordinates,  D  is  the  screen 
center-eye  distance  ana  S  is  half  the  screen  size  in  the  same  units  as 
D.  (The  screen  is  assumed  square.) 


The  four  V  variables  are  windowing  parameters.  The  winoow  (screen)  is 
2VSX  units  wiae  ana  2VSy  units  high  ano  in  the  same  units;  the 
screen  center  is  at  (VCx,VCy). 

Depth  (2g)  is  required  for  occultation  only.  The  simplest  form  for 
Zs  is  Zs  =  Ze.  This  form  is  quick  because  it  avoids  extra 
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computation;  nowever,  a  large  number  of  bits  may  be  reouireo  for  its 
perceptually  aoequate  application  in  occuitation  tests.  The  other 
form  for  zs  is  computationally  expensive  out  allows  for  finer  oeptn 
itsolution  nearby  ano  coarser  resolution  in  the  aistance,  so  that 
fewer  bits  are  requireo  for  the  specification  of  Zs.  In  this  form, 

"F"  is  the  maximum  aepth  allowed  in  the  system.  Note  that  as  F 
approaches  ,  Zs  =  1  -  D/Iq,  demonstrating  the  relationship 
uetween  resolution  ano  aistance  more  clearly.  The  form  Zs  =  Ze 
snouio  be  useu  for  real-time  application. 

The  benefit  from  this  portion  of  the  perspective  transformation  is 
tnat  the  scene  wiil  be  aisplayea  as  if  seen  or  sensea  from  an  actual 
aircraft  at  an  ioentical  position  and  orientation.  The  major  concern 
is  the  division  by  the  object  aistance.  This  can  oe  time-consuming 
umess  one  uses  a  fast  multiply  chip  and  a  reciprocal  for  the  number. 
Fast  divide  chips  are  expected  to  be  available  soon. 

3. 1.3.1  Operations — The  perspective  transformation  of  a  patch  is 
accomplished  by  transforming  all  four  patch  vertexes  in  parallel. 

Since  one  subdivision  produces  four  patches,  the  total  number  of 
perspective  transformations  per  frame  time  equals  four  times  the 
number  of  subdivisions  per  frame  time.  Solano,  Voth,  ana  Narenara 
U>bl)  estimate  that,  on  the  average,  rough  terrain  requires  1.7  x 
IQ6  suocivisions  per  frame.  Consequently,  6.8  x  106  perspective 
transformations/ frame  are  expected  on  the  average.  Each  vertex 
transformation  requires  nine  multiplies,  six  aods,  and  two  aiviaes. 

Tne  multiplication  and  aivide  operations  can  be  implementeo  in 
parallel,  as  shown  in  Figure  2.  Also  the  adds  are  both  in  series  ano 
in  parallel,  as  shown  in  Figure  2. 

3.1.4  Viewpoint  Maneuverability 

A  viewpoint  may  be  defined  by  six  variables:  three  for  spatial 
position  ana  three  for  orientation.  The  Honeywell  algorithm  allows 
any  value  for  all  of  these  variables  and  so  accommodates  all  possible 
viewpoints.  The  speed  with  which  a  viewpoint  may  change  is  limited  by 
the  access  time  of  obtaining  new  patch  information.  There  are 
essentially  three  types  of  movement  which  require  new  patches: 

1.  Roll— longitudinal  axis  of  aircraft  constant 

2.  Movement  in  space— orientation  constant 

3.  Pitch  ana  yaw — change  in  orientation 

For  horizontal  movement  in  space,  a  small  circular  crescent -shaped 
area  must  be  obtained  each  frame  time.  The  area  is  given  by: 

A  =  hR 
where 

h  =  aistance  flown  horizontally  (worst  case) 

R  =  radius  to  the  horizon 
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with  a  velocity  of  500  mph  or  223.5  m/sec,  h  =  3.725m  ano  R  =  24  km 
gives  A  =  90,000  mz  =  10  patcnes  *  368  oits/frame  time. 

The  angular  veiocicy  of  roil  is  proportional  to  flight  speeo.  Unaer 
extreme  conditions,  a  pilot  may  perform  a  360°  roll  in  1  sec.  This 
is  equivalent  to  t>°  in  one  frame  time.  The  front  winaow  FQV  will 
not  change  much  with  a  roli,  Put  siue  winaow  FQVs  will  change 
consiaeraDly .  For  a  60°  x  60°  siae  FQv,  a  6°  change  is  the  same 
as  i/lO  of  the  FGV.  With  the  sioe  view  inclusive  of  all  patches  out 
co  cne  norizon  within  a  6QP  sweep,  changing  the  screen  FQV  by  1/10 
will  at  worst  introduce  a  few  nearby  patches  ouring  horizontal 
fiighc.  For  a  vertical  flight  path,  a  roll  will  require  updating  1/10 
x  40,000  patches  each  frame  time,  which  we  regarG  as  the  worst-case 
roll : 

worse  case  Roll  =  4000  patches  x  3&8  Dits/frame  time 

When  the  pilot  changes  the  aircraft  airection,  he  is  limited  by  the 
inertial  forces  on  nimself  ana  the  aircraft.  We  shall  assume  a 
maximum  acceleration  of  9  g's.  A  constant  change  in  direction  at 
constant  speed  results  in  a  circular  path  with  a  centripetal 
acceleration  of: 

2 

5g’s  = 
where 

v  =  forwaro  aircraft  speed 
R  =  radius  of  aircraft  circular  path 

with  v  =  223.5  m/sec,  and  lg  =  10  m/sec2,  R  =  555m.  The  circle 
circumference  =  2trR  =  3487m. 

In  1/60  sec,  the  aircraft  travels  o  =  vt  =  223.5/60  =  3.725m  ana  the 
cnange  in  the  aircraft  heading  "A"  is  given  by: 

A  3.725  .  „ 

36CP  =  3487  ’  A  =  0,38 

Turning  by  0.38°  requires  updating  253  patches  x  368  bits  each/frame 
time.  Tnus  tne  transfer  rate  of  each  case  is: 

1.  27  Kbytes/sec 

2.  11  Mpytes/sec 

3.  0. 7  Mbytes/sec 

The  second  ana  third  cases  have  assumed  a  transfer  rate  from  disc  to 
hign-speea  memory  necessitated  because  the  high-speea  memory  only  covers 
the  FOV  of  60°.  If  the  high-speed  memory  is  increased  to  hold  all 
360°  out  to  24  km,  cases  2  and  3  are  no  problem,  ana  case  1  becomes  the 
limiting  transfer  rate.  To  avoid  incoherent  imagery  during  rolls,  the 
larger  high-speea  memory  is  considered  to  be  the  superior  option. 
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_>.i.3  Fieio  of  View 

The  concept  oeveloped  in  tnis  study  can  generate  valia  images  independent 
of  the  FGV  ano  can  simultaneously  compute  images  for  multiple  image 
pianes.  The  stanoaro  FOV  for  this  report  is  60°;  however,  any  FQV 
from  G°  to  160°  may  theoretically  be  employea  for  each  image  plane. 

The  complexity  of  this  system  increases  with  the  FOV;  that  is,  180° 
requires  approximately  three  times  the  haraware  of  60°. 

There  are  two  parts  to  the  solution  for  selecting  the  FOV.  The  first 
part  requires  traversing  a  oata  structure  callea  a  quao  tree.  The  quaa 
tree,  at  its  highest  level,  diviaes  the  data  base  into  quarters.  At  the 
next  ievei  oown  the  tree,  each  quarter  is  itself  suboivioeo  into 
quarters.  This  subaivision  continues  until  the  smallest  resolution  in 
tne  aata  oase  is  reao.  This  is  the  level  at  which  the  subaivision 
dimensions  match  the  sample  interval  oetween  elevations  in  the  worio  oata 
base.  The  areas  of  oata  corresponding  to  the  smallest  oata  oase 
resolution  are  called  patches. 

The  first  part  of  the  FOV  selection  requires  collecting  all  patches 
containea  in  the  FOV.  This  is  aone  by  projecting  levels  of  the  quao  tree 
to  the  oispiay  coorainates.  If  a  subaivision  lies  entirely  outsiae  the 
viewing  wmaow,  that  subaivision  and  all  those  lower  than  it  can  be 
pruned  from  the  tree.  Patches  partially  in  the  FOV  shoula  be  subdiviaea 
oy  the  methoa  Oescribea  in  subsection  3.2.3  ana  then  those  subpatches 
snoulo  be  tested  for  inclusion. 

After  all  patches  wholly  or  partially  containea  in  the  FOV  have  been 
locatea,  the  parts  of  polygonal  objects  outsiae  the  fiela  need  to  be 
clippea  out.  That  is,  some  objects  may  be  partially  in  the  FOV.  So  as 
not  to  waste  time  processing  points  that  are  not  to  be  aisplayea,  these 
oojects  are  clipped  at  the  borders  of  the  FOV. 

3.1.6  Resolution 

A  6QP  FOV  on  a  screen  of  aimensions  1024  x  1024  pixels  is  assumea. 

This  is  one-sixth  of  the  data  we  have  stored  in  the  fast  FOV  memory.  For 
the  vast  majority  of  cases,  this  is  sufficient  for  sharp,  clear  imagery. 

A  further  increase  in  apparent  resolution  is  obtained  by  the 
anti-aliasing  method.  Leler  Q98Q)  describes  this  perceptual  effect  in 
some  aetail.  The  image  generation  system  has  been  designed  to  meet 
visual  resolution  standards  ano  is  more  than  aaequate  for  the  less 
resolute  1R  ano  LLLTV  sensor  simulations. 

3.1.7  Image  Mapping 

This  subsection  discusses  the  applicability  of  a  spherical  display 
surface  oesignea  to  achieve  a  constant  resolution  over  the  entire 
display.  Comparea  to  a  flat  oispiay  surface,  a  spherical  surface  can 
ostensibly  reauce  the  system  cost  by  requiring  fewer  total  pixels. 
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Consicer  the  three  coordinate  systems  illustrateo  in  Figure  11; 

UW,VW,ZW;  are  the  stationary  world  coordinates,  (X,Y,Z)  are 
"parallel"  coordinates  with  axes  always  parallel  to  world  coordinates  ana 
with  origin  at  tne  pilot's  eye,  and  (Xe,Ye,Ze)  are  orthogonal 
coordinates  with  the  same  origin,  but  with  axes  oriented  so  that  Zp 
pierces  the  screen  center  ana  Xe  ano  Ye  are,  respectively,  parallel 
to  tne  vertical  and  horizontal  screen  borders.  The  eye  coordinates  and 
screen  are  detailea  in  Figure  12.  Note  that  screen  coordinates  are  given 
by  tne  two  angles  0  ano 

Given  a  point  (P)  in  world  coordinates,  its  parallel  coordinates  are 
X  =  xw  -  0X  v  =  Yw  -  0y  Z  =  zw  -  0Z 
wnere  Qx,  0y,  02  =  origin  in  world  Cdordinates. 

In  eye  coordinates,  (P)  is  given  by 

Xe  =  Ue,X)X  +  (Xe,  Y)Y  +  (Xe,Z)Z 

Ve  =  (Ye,X)X  +  (Ye,Y)Y  +  (Y  ,Z)Z 

Ze  =  (Ze,X)X  +  (Ze,Y)Y  +  (Ze,Z)Z 

where  (,Xe,X)  =  cosine  of  the  angle  between  the  Xe  ano  X  axes, 

(xe,Y)  =  etc.  Note  that  these  direction  cosines  are  constants  over 
the  entire  frame,  independent  of  the  value  of  P,  ano  are  recomputed 
each  frame  time. 


xw 


Figure  11.  Image  mapping  coordinate  systems. 


Figure  12.  Spherical  screen  coordinates. 
Finally,  the  screen  coordinates  (0,<|>)  are  given  by: 


0  =  tan 


-1<V  *  Ze2)1/2 


A  ,  -lZe 
<j>  =  tan  — 

Ye 


Screen  aepth  can  be  approximated  by  Zq;  no  radius  is  necessary. 


To  avoia  excessive  computation  time,  both  the  arc-tangent  and  the 
square  root  shoulo  be  determined  by  table  look-up  and  linear 
interpolation.  Unfortunately,  the  square  root  must  be  taken  over  a 
wiae  range,  making  linear  interpolation  inaccurate.  If  the 
square-root  term  is  slightly  inaccurate,  then  the  arc-tangent  will 
only  exacerbate  the  problem.  Since  the  (0 , 4>)  coordinates  must  be 
quite  accurately  determined  (within  1/5  pixel  x  1024  pixels),  the  flat 
screen  perspective  transformation  should  be  used  instead. 


3.1.8  Qccuitation 


In  the  AVSS  system  proposed  here,  the  resolution  of  priority  conflicts 
is  aone  by  using  a  depth  or  distance  buffer,  or  a  z-buffer.  This  is 
aone  so  features  nearer  the  viewpoint  properly  occlude  features 
farther  away.  A  frame  buffer  holds  the  intensities  of  display  points 
as  they  are  generateo.  The  depth  buffer  stores  the  distances  of  these 
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same  points  ano  resolves  priority  conflicts  Dy  Keeping  uotn  the 
intensity  ana  uistance  of  only  tne  nearest  point  .vnen  conflicts 
occur.  A  conflict  occurs  when  two  terrain  patcnes  or  ocjects  project 
to  the  same  position  in  tne  screen  space.  See  Appenoix  A  for  a 
oiscussion  of  other  occultation  techniques. 

Tne  aeptn  or  uistance  u sea  in  the  conflict  resolution  wili  be  ze 
rather  tne  zs.  Briefly,  ze  is  the  oistance  of  a  point  from  the 
uoserver's  eye  ana  zs  is  a  point's  aepth  in  the  screen  coorainate 
system.  Using  ze  for  comparison,  the  values  can  occur  in  a  oroao 
range.  Using  zs,  tne  values  are  normalizea  between  zero  ana  one. 

This  approach  is  somewnat  high-speea  memory  intensive.  Items  that 
must  oe  consiaerea  here  involve  the  amount  of  memory  required  ana  the 
memory  layout. 

Tne  memory  requirements  are  two  frame  buffers  for  intensity  plus  one 
frame  buffer  for  the  z-buTfer.  The  calculation  for  tnis  is: 

1 .  Frame  Buffer  Memory 

2  *  _>  "colors  8  bits/color  *  1024  *  1024  *  3  (anti-alias)  ~  19 
x  106  bytes 

2.  z-ouffer 

1024  x  1024  *  24  bits  (range)  *  3  (anti-alias)  ~  10  x  106 
bytes 

The  total  is  29  Mbytes  of  high-speea  memory. 

4t  this  point,  the  system  might  time  out  unless  some  novel  techniques 
can  ue  usea  to  get  the  aata.  For  instance,  on  a  low  flight 
simulation,  a  large  number  of  z-buffer  tests  will  be  mace.  More  areas 
can  be  occluaea  as  one  gets  closer  to  the  ground  with  this  simulator. 
The  number  of  perspective  transforms  remains  roughly  constant. 

For  reaaout,  the  intensity  memory  can  be  a  well-established  bit  plane 
structure  using  dynamic  Ranoom  Access  Memories  (RAMs).  During  the 
intensity  calculation,  a  buffer  might  be  needea  between  the  intensity 
calculation  ana  frame  buffer.  For  example,  the  screen  space  coula  be 
aiviaea  into  vertical  segments,  each  16  or  32  pixels  wiae.  Then  the 
Duffer  mentionea  would  be  approximately  300  kilobytes  (Kbytes)  of 
nigh-speea  static  RAM  (see  Figure  13). 

A  oenefit  of  the  z-buffer  approach  is  that  when  the  frame  is 
aisplayea,  the  distance  to  each  pixel  is  available  for  intensity 
modification  aue  to  haze,  fog,  or  ether  atmospheric  attenuation. 
Furthermore,  no  sorting  is  required  (as  in  scan  line  algorithms),  no 
ambiguities  occur,  and  the  constraint  on  resolution  is  the  z-buffer 
size  rather  than  the  quickness  of  a  sort  in  z. 


Figure  13.  Frame  Duffer  implementation. 


3 . z  IMAGERY  CHARACTERISTICS 

Tne  most  important  area  to  be  coverea  in  the  AVSS  approach  is  imagery 
characteristics.  The  system  oevelopea  as  part  of  tnis  stuay  has  the 
capability  to  produce  imagery  of  much  higher  quality  than  that 
available  with  conventional  eage-based  systems.  The  general 
requirements  are  in  regard  to 

1.  Tonal  computation 

2.  Texture 

3.  Terrain  ana  hydrographic  features 

4.  Cultural/feaiures 

5.  Shaaow 

6.  Special  capabilities/considerations 
3.2.1  Tonal  Computation 

In  the  AVSS  concept,  it  is  oesired  to  generate  imagery  in  the  visual 
sense  but  also  imagery  from  IR  ana  LLLTV  from  the  same  oata  base. 

Each  of  these  systems  is  considerea  in  the  following  order:  FLIR, 
LLLTV,  ano  visual.  The  primary  difference  among  the  three  systems  is 
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tne  conax  difference  in  uiacK-to-wnite  intensity  or  coicr  oue  to  the 
specific  sensor  cnaractenstics.  nence  tne  major  prooiem  is  in  tne 
cats  case  preparation  ano  not  in  tne  perspective  suooivision  or 
reai-t.Line  area.  However,  the  intensity  calculation  wiii  oe  affecteo 
oy  attenuation  factors 

3.^. 1.1  FlIR — The  moael  for  IR  imagery  requires  that  the  temperature 
ana  emissivity  oe  known  for  eacn  ooject  ana  material  to  oe  aispiayeo. 
Given  tnis  information,  tne  FlIR  sensor  output  can  pe  caiculatea.  The 
total  energy  receiveo  at  the  cetectors  is  the  sum  of  ail  tne 
contributions  from  the  scene  witnin  tne  element's  projection  on  the 
grouna.  The  intensity  is  computea  by  aiviaing  the  raGiant  energy  by 
pi. 

The  next  step  in  the  calculation  is  to  compute  the  irraaiance  at  the 
sensor  aperture.  IrraGiance,  h,  is  obtained  by  aiviaing  the  raaiant 
intensity,  J,  by  tne  slant  range  squarea  ana  multiplying  by  an 
atmospheric  attenuation  factor: 

H  =  (,e"0lR)  G/R2 


The  atmospheric  attenuation  factor,  e-0^,  moaels  the  effect  of  the 
atmosphere  on  the  irraaiance.  The  attenuation  coefficient,  a,  is  a 
function  of  tne  environment  ana  the  sensor  wavebana. 

Finally,  the  calculation  is  completea  by  multiplying  the  irraaiance  by 
tne 

2 

area  of  the  sensor  aperture  (irDQ/4)  ana  the  optical  efficiency: 


Note  that  this  analysis  assumes  that  the  temperature  is  known.  It 
aepenas  on  the  time  of  aay,  sun  raoiance,  cloua  cover,  moisture 
content  in  the  backgrouno,  and  other  factors.  In  oraer  to  generate 
the  images  in  infrarea,  a  moael  will  have  to  be  chosen  ana  the  effects 
of  that  model  will  appear  in  the  simulation.  Also,  a  lot  of 
information  must  be  adaea  to  the  aata  base. 

3.2. 1.2  LLLTV — Tne  low  light  level  systems  in  use  toaay  are  the 
silicon  viaicon  ana  its  derivatives  ana  fiber-aptically  coupled 
singie-oiode,  aouble-diode,  or  micro-channel  image  intensifier 
systems.  The  simplest  device  is  the  silicon  viaicon,  which  has  a 
response  extending  into  the  near-infrared,  especially  when  used  with 
tungsten  iighting.  An  object  is  seen  against  its  background  because 
there  is  a  reflectivity  aifference  causing  contrast.  The  wavelength 
dependence  of  the  contrast  is  determined  by  the  materials  involved. 
However,  no  one  material  can  be  characterized  by  a  single  reflectivity 
curve,  so  materials  are  usually  characterized  by  their  average 
reflectivity. 
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Several  parameters  must  oe  consiaerec  in  tne  generation  of  tne  ;_I_lTv 
imagery.  A  few  of  tnese  are  tne  intensity  of  tne  liiumination  failing 
on  tne  scene,  tne  intensity  of  tne  illumination  oue  to  scattering,  tne 
atmospneric  attenuation,  ana  tne  reflectivity. 

As  tne  iignt  level  increases,  the  contrast  in  lLLTV  oecreases  ana  it 
oecomes  increasingly  Difficult  to  pick  out  tne  areas  of  interest  for 
cues. 

3.i.l.;>  Achromatic  Intensities  in  the  Visiple  Spectrum — Each  flat 
surface  element  in  an  FOV  requites  an  intensity  value.  This  applies 
Ootn  to  cultural  fiat  surfaces  representing  nouses,  factories,  etc  ana 
to  tne  smaii  flat  quaarilaterais  useo  to  approximate  curvea  terrain. 
This  suosection  will  Describe  tne  metnoo  of  applying  intensities  to 
computer-generatea  surfaces. 

The  most  general  real-time  illumination  moael  inciuaes  both  specular 
ana  aiffuse  terms  for  tne  liyht  reflectea  off  a  surface.  The  aiffuse 
reflecteo  intensity  is  given  by: 

ID  =  IA  +  Rq  max  N  .~t) 


where 

Iq  =  Diffuse  intensity 

IA  =  amDient  intensity 

Rq  =  aiffuse  reflectivity 

iN  =  surface  normal  (normalized) 

L  =  sun/moon  airection  vector  (normalized) 

Tne  aot  p roquet  must  be  tnresholdea  at  zero  because  of  non-physical 
negative  N  .  values  when  the  surface  is  facing  away  from  the  sun. 
Diffuse  reflectivity  is  a  function  of  the  surface  material  and  is  a 
constant  proviaea  off-line.  Ambient  intensity  is  the  intensity  a 
surface  will  have  in  shadow.  Thus  it  is  a  function  of  the  weather, 
illumination  source,  ana  surface  material,  ana  is  a  constant  provided 
off-line. 

For  the  vast  majority  of  intensity  calculations  (including  terrain 
surfaces,),  the  aiffuse  term  alone  is  adequate  for  purposes  of 
realism.  For  a  few  isolated  objects,  however,  specular  reflections 
are  quite  important.  The  specular  component  of  the  reflected 
intensity  from  a  surface  is  given  by: 

Ie  =  R.  max  (0,  uT  . 1h)C);  IT  =  L 

\L  +  El 
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wnere 


I5  =  specular  intensity 
=  specular  reflectivity 
c  =  snininess  coefficient 
l  =  sun/moon  airection  vector 
E  =  viewing  airection  vector 

Specular  reflectivity  ana  the  shininess  coefficient  are 
surface-aepenaent,  assignea  off-line.  If  is  tne  vector  airecteo  from 
tne  surface  element  to  the  viewer's  eye,  wnich  must  be  recomputea  each 
frame  time. 

Tne  final  factor  in  the  intensity  computation  is  the  atmospheric 
attenuation  with  aistance.  The  attenuation  coefficient  is 
waveiength-oepenoent  and  can  oe  aajustea  for  other  spectral  regions. 
The  final  intensity  equation  for  an  achromatic  surface  is: 

ID  =  (Iq  +  Is)  e-^r  +  1B  U  -  e-<*r) 

wnere 

Iq  =  "observea"  intensity  of  surface  element 
1q  =  oackground  (sky)  intensity 
a  =  attenuation  coefficient 

r  =  slant  range  (aistance  from  observer  to  surface  element) 

3.z.i.4  Color— There  is  an  abunaance  of  theories  relating  human  color 
perception  ana  methods  for  proaucing  color  images.  An  HSV  color  space 
methoa  is  usea  here,  for  two  reasons: 

i .  The  aata  base  must  be  enhanced  to  make  accurate  color 
pictures.  This  means  associating  some  sort  of  color 
information  off-line  with  terrain  ana  cultural  object 
surfaces.  The  HSV  space  is  consistent  with  intuition  ana 
therefore  tenas  to  minimize  errors  ano  proceoural  confusion. 
Hue  is  the  aimension  normally  aescribeo  by  aojectives  like 
raa,  green,  purple,  etc;  that  is,  it  is  what  the  layman 
calls  color.  Saturation  is  a  measure  of  the  oeparture  of  a 
hue  from  achromatic,  that  is,  from  white  or  gray.  For 
example,  rea  is  more  saturatea  than  pink.  Value  measures 
Departure  from  black,  ano  for  purposes  of  this  report  is 
equivalent  to  intensity  as  aescribeo  above. 
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2.  The  simulation  of  shaaow  and  atmospheric  effects  must  be 
incluaea.  Both  of  these  can  be  nandled  by  the  general 
equations : 

Hq  =  H  .  e_otr  +  Hb(1  -  e-«r) 

V0  =  VL  .  Se-«r  +  VB(1  -  e"^) 

S0  =  S  .  e~ar  +  Sb(1  -  e-ar) 
where 

h,S  =  hue  and  saturation  of  object  surface  on  a  (0,1)  scale; 
assigned  off-line 

VL  s  =  value  (intensity)  of  surface  in  light  or  shadow 
(L,S)  computed  each  frame  time 

hB»vB»^8  =  hue,  value,  and  saturation  of  sky  (depends  on 
weather;  assigned  off-line) 

The  above  formulation  allows  a  simple  weighted  average  among  all  quantities. 
This  should  be  compared  to  the  obscure  problem  of  dealing  with  haze,  say,  in 
RGB  space.  Note  that  e_ar  is  to  be  computed  once  per  polygon  surface 
element. 

Ze  can  be  used  in  place  of  "r"  as  a  time-saving  approximation  and  will  not 
be  too  inaccurate  because  the  FOV  is  300  on  either  side  of  the  Ze  axis, 
ana  Zp  *  r  for  large  Ze,  where  atmospheric  effects  predominate. 

Finally,  e'^e  can  be  determined  by  table  look-up. 

To  summarize: 

Information  stored 
off-line;  accessed 
for  each  surface 
element  each 
frame  time 


H,S,Ia,Rd*rs:  Surface  element 
hue,  saturation,  ambient  intensity, 
diffuse  and  specular  reflectivities. 
HB»sB>vBla*L:  Sky  hue, 
saturation,  value,  attenuation 
coefficient,  and  sun/moon  direction 
^  vector. 


Information  computed 
each  frame  time  for 
each  surface  element 


N,E,Ze  =  r:  Surface  normal  vector, 
eye  vector,  and  distance  from  eye 
to  surface  approximated  by  Ze. 


The  above  values  are  used  to  Determine  the  final  hue,  saturation,  ana 
value  of  each  surface  element;  H0,  SQ,  V0;  where: 

Hq  =  H  .  e~°^e  +  Hg(l  -  e_0t2e) 

S0  =  S  .  e-^e  +  SB(1  -  e-^e) 

V0  =  VB  (1  -  e-ctZe) 


For  display  with  a  device  using  the  usual  RGB  color  cube,  h0,  Sq, 
ana  V0  neea  to  be  convertea  to  RGB  space  quantities.  The  algorithm 
for  this  was  published  by  Smith  (1978): 

H'  =  6  .  H0 

I  =  floor  (H ’ ) 


F  =  H'  -  1 
M  =  Vq  (  I  -  Sq  ) 

N  =  V0(l  -  (S0  .  F)) 

K  =  V0  (1  -  [Sq  .  (1  -  F)]) 


Then  switch  on  I  into 


Case 

Case 

Case 

Case 

Case 

Case 

where 


0: 

(R,G,B) 

1: 

(R,G,B) 

2: 

(R,G,B) 

3: 

(R,G,B) 

4: 

(R,G,B) 

5: 

(R,G,B) 

(V0,K,M) 

(N,Vq,M) 

(M,Vq,K) 

(M,N,Vq) 

(K,M,Vq) 

(Vq.M.N) 


1.  Floor  (H ' )  is  the  integer  just  less  than  or  equal  to  H'. 

2.  Only  one  case  is  executed  on  the  switch  statement. 

3.  (Hq,  Sq,  V0)  and  (R,  G,  B)  are  normalized  on  the  range 
0  to  1. 


To  do  these  color  operations  on  a  computer  would  require  13 
multiplies,  13  adds,  one  divide,  one  square  root,  an  integer 
operation,  and  an  exponential  multiply.  For  real  time,  a  parallel 
pipeline  organization  will  be  usea.  At  present,  a  block  diagram  is 
shown  in  Figure  9;  the  only  item  not  shown  is  the  Switch  on  I  logic. 
The  number  of  channels  of  this  architecture  has  not  been  determined. 
The  intensity  calculation  will  have  to  be  done  on  approximately  5  x 
106  polygons  for  the  mission  area  to  be  considered  here. 
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3.2. 1.5  Other  Possibilities — The  dot  product  forJ:he  intensity 
calculation  must  oe  normalized;  that  is,  in  TT •  JT,  both  iTana  l 
must  De  unit  vectors.  Since  L  can  be  made  a  unit  vector  off-line,  the 
diffuse  intensity  can  oe  written  as: 


where  IN! 


(Nx2  + 


Ny' 


NzV/2 


N  is  determined  for  each  surface  element  each  frame  time  and  adds 
negligible  expense.  Because  finding  TFTT  is  computationally 
expensive,  and  there  is  no  known  simple  and  accurate  approximation  of 
it,  this  should  be  investigated  in  more  depth  before  the  above 
intensity  model  is  adopted. 


A  further  possible  intensity  model  is  one  in  which  only  certain 
special  sun  positions  are  allowed.  For  example,  with  a  sun  at  45° 
altitude  in  the  northwest,  Horn  (1979)  determined  the  intensity  of  a 
surface  approximately  with  the  following  simple  linear  formula: 

I(p,q)  =  0.4285(p  -  q)  -  0.0844  Ip  +  ql  =  0.6599 

where 


p  =  slope  in  East-West  direction 
q  =  slope  in  North-South  direction 

Since  p  and  q  may  be  easily  obtained  in  a  recursive  process  of 
subtracts  and  adds,  this  model  would  be  very  quick.  Future  efforts 
should  pursue  a  more  flexible  process.  Perhaps  similar  linear 
formulas  can  be  manufactured  for  arbitrary  sun  locations. 

3.2.2  Texture 

The  simulation  of  terrain  and  object  textures  is  an  especially 
important  task  with  respect  to  training  effectiveness.  It  is  clear, 
for  instance,  that  a  single  tone  surface  representation  alone  gives 
the  pilot  no  indication  of  distance.  Furthermore,  the  movement  of  the 
edges  of  such  regions  over  the  pilot's  FOV  appears  to  provide 
inadequate  depth  information,  judging  from  the  failure  of  current 
systems  to  accurately  simulate  low-level,  high-speed  flight. 

Although  Gibson  (1950)  qualitatively  demonstrated  the  importance  of 
movement  parallax  in  the  ability  of  trained  pilots  to  land  aircraft, 
very  few  quantitative  studies  have  been  made.  Of  these,  perhaps  the 
most  revealing  is  a  theoretical  analysis  of  the  mathematical  and 
visual  invariants  in  movement  parallax  by  Koenderink  and  van  Doom 
(1976).  In  the  conclusion  of  their  analysis  they  state  that  time 
change  of  texture  density  conveys  information  about  orientation  and 
distance. 
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Funner  support  for  tne  contention  tnat  texture  is  important  as  a 
instance  cue,  especj.aj.iy  fGr  nearoy  objects  in  low-ievel  flight,  is 
founu  in  dajcsy,  Fneoman,  ana  Sioan  (1576).  In  tneir  aostract  they 
state  tnat  texture  graoient  gives  a  qualitative  value  for  aistance. 

Thus  it  appears  that  in  a  moving  environment,  realistic  changes  in 
texture  piovioe  Distance  ana  orientation  information.  This  conclusion 
nas  serveu  as  the  primary  motivator  in  the  aesign  of  an  appropriate 
texture  yeneration  algorithm. 

j>. i.2.1  Terrain  Texture — Our  primary  texture  generation  methocology 
is  an  extension  of  trie  fractal  tecnniques  intiooucea  by  Manaelbrot 
(i577;  ana  Geveiopea  oy  Fournier  ana  Fusseli  (1580)  ano  Carpenter 
U580).  The  metnoos  of  these  authors  represent  natural  irregular 
objects  anG  terrain  by  moaeling  them  as  sample  paths  of  stochastic 
processes.  The  particular  stochastic  process  is  callea  "fractional 
Brownian  motion."  The  implementation  of  fractal  texturing  allows 
computing  tne  surface  to  arbitrary  levels  of  oetail  without  increasing 
the  aata  oase.  Therefore,  the  simulation  will  result  in  a  continuous 
change  of  aetail  ana  texture  aensity  for  all  flight  paths. 

In  aGaition,  Fournier's  technique  ensures  that  macroscopic  texture 
features  will  remain  iaentical  while  finer  aetails  in  the  texture 
change,  preserving  ooject  or  texture  ioentity.  This  occurs  because 
ms  methoa  requires  seeas  for  ranaom  number  generators.  These  seeds 
are  linkeo  to  patch  corners  to  assure  coherence  across  patch 
bounaaries  within  a  single  frame,  ana  the  seeas  ao  not  change  from 
frame  to  frame.  This  means  that  surface  perturbations  at  patch 
corners  are  fixed.  Interior  perturbations  are  computed  by  recursive 
suoaivision,  using  the  result  of  the  previous  subdivision  as  the  seed 
for  tne  next  point.  Thus,  if  the  subdivision  level  for  a  patch  is  not 
cnangea  from  one  frame  to  the  next,  the  surface  perturbations  are 
iaentical.  But  if  the  level  of  aetail  does  change,  the  larger 
perturbations  are  maintained  ana  only  the  finest  perturbations  are 
aiterea. 

Off-Line  Generation  of  Texture  Labels — Preparatory  to  real-time 
texture  generation  with  fractals  is  an  off-line  procedure  which  begins 
with  a  iist  of  DMA  perimeters  of  areas  aesignatea  by  aifferei.t  surface 
material  categories  (SMLs).  The  procedure  enas  with  each 
lUQ-meter-square  area  (loosely  callea  a  patch)  in  the  mission  area 
oeing  assigned  a  texture  cooe.  Part  of  the  off-line  generation  is 
uenveo  from  traditional  chain  cooing  techniques,  Rosenfela  ana  Kak 
(1576),  ana  the  rest  is  a  Honeywell  aooition.  A  broaa  outline  of  the 
off-line  texture  label  proceaure  is  aiagrammea  in  Figure  14;  a  more 
aetanea  narrative  aescription  follows: 
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CULTURAL  AREA  1-&4  ARTIFICIAL  h-M  PERIMETER  GRID  (-M  NEAREST 


Figure  14.  Off-line  generation  or  texture  labels. 


1.  The  ciuturai  part  of  the  DtwA  Gata  uase  provioes  lists  of  area 
perimeters,  wnere  eacn  list  contains  clcckwise-oroereo  (x,y) 
cooroinates  of  several  points  serving  to  outline  the  area. 

The  cooroinates  are  in  latituce  ano  longitude  offsets  from  a 
reference  point.  The  DMA  notes  tnat  the  borGer  definition  is 
not  guaranteed  to  close  if  the  region  ooroer  extends  beyono 
the  manuscript  eoge.  Testing  for  closure  ano  correction 
takes  place  immediately  after  the  construction  of  a  chain 
coue  border  representation. 

2.  Chain  Cooe  construction:  Figure  15  illustrates  an  example  of 
a  perimeter  aefineo  by  a  small  number  of  points.  To  chain 
cooe  this  perimeter,  an  artificial  grio  is  constructed  on  the 
same  scare  as  the  DMA  elevation  data  base,  so  that  eacn 
corner  in  the  artificial  grio  falls  in  the  center  of  each  DMA 
terrain  paten. 

Starting  with  the  first  (x,y)  point  in  the  list,  traverse  the 
perimeter  clockwise  ano  at  each  intersection  of  the  perimeter  with  a 
grio  line,  determine  the  nearest  grio  corner.  In  Figure  15,  the  first 
such  corner  is  at  A,  the  second  is  at  B,  etc.  The  cnam  cooe  itself 
is  an  eight-oirectional  cooe  which  specifies  the  airections  between 
successive  grio  corners.  For  example,  in  going  from  A  to  3  the  cooe 
is  0,  from  C  to  D  it  is  1;  ana  from  H  to  I  it  is  4. 

Reaunaant  information  from  successive  intersections  giving  the  same 
corner  is  excluaeo.  For  instance,  near  the  corner  I  there  are  two 
intersections;  the  secono  intersection  is  ignorea. 

Finally,  singularities  in  the  cooe  must  be  removea.  In  our  example,  a 
singularity  exists  where  the  nearest  corners  are  successively  F-G-F, 
leaaing  to  a  chain  cooe  of  73,  a  line  segment  that  reverses 
direction.  Any  time  opposite  chain  cooe  number  pairs  (40,  51,  62,  73) 
occur,  they  will  be  excluaeo. 

Once  the  final  cnain  cooe  is  constructeo,  it  can  be  testeo  for  closure 
oy  the  following  rule,  which  applies  to  chains  of  arbitrary  length: 

Rule  for  Closure:  If  n^  +  n2  +  nj  =  05  +  n6  +  n-j 

ana  nj  +  n^  +  nj  =  nj  +  ng  +  n^  are  both  true, 

then  the  cnain  (ana  bounaary)  is  closea;  where  n^  =  number 

of  chain  cooe  numbers  (i). 

(Note  that  throwing  out  opposite  chain  cooe  number  pairs  leaves  the 
above  rule  intact.) 

Intersection  Procedure — The  determination  of  grid  line  ana 
bounaary  intersections  used  for  chain  cooe  construction  is 
accomplished  a  line  segment  at  a  time.  Each  line  segment  is  specif iea 
by  its  two  enapoints.  Knowleage  of  these  enopoints  allows  the 
specification  of  all  horizontal  ano  vertical  grio  lines  which  will  be 
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intersected  oy  the  line  segment,  txplicitiy,  given  the  enapoints 
Pj.,  P2  =  Ui,y2),  i,x2,  y2) ,  tne  vertical  grid  lines 
intersected  oy  the  segment  PjP2  will  oe: 

X  3  Ki  +  K^^ip) 

X  =  Kl  +  K2(in+1; 

X  *  Kl  +  X2Un+2) 

etc 

where  Kl  ana  K2  are  Cdnstants  anc  in  is  seme  integer  value  such  that 
x  falls  between  x2  ana  X2. 

Similarly,  the  ncnzcntal  grid  lines  intersected  by  P2P2  are  given 

°y : 

y  =  K3  + 

y  *  K3  +  K4Um+1) 
etc 

where  y  fails  between  y2  ana  y2. 

it  is  essential  that  the  intersecticns  fall  in  an  araerea  sequence 
pragressing  fram  P^  to  P2,  so  that  the  chain  cooe  makes  sense. 

Because  the  intersections  all  lie  along  a  line,  they  can  be  sorted 
accoraing  to  ascending  x  values  when  x2  >  x2  ano  aescenaing  x  when 
x2  <  Xj_.  Also,  because  the  number  of  intersections  is  usually 
quite  smail  (<50)  in  terms  of  sorting,  and  the  x  and  y  lists  are 
closely  interleavea,  a  merge-sort  which  is  approximately  (n  log  n)  in 
time  will  suffice.  Once  the  ordered  intersections  are  obtained, 
nearest  grid  corners  can  oe  computed  by  simple  compare  operations. 

boundary  Points  ano  Patch  Corner  Designation — Once  the  chain  cooe 
for  a  perimeter  is  established,  it  can  be  used  to  determine  what  are 
callea  "boundary  points"  ano  these  can  be  used  to  determine  texture 
labels.  The  procedure  can  be  understood  by  studying  the  example  in 
Figure  16.  The  heavy  line  represents  the  perimeter  drawn  from  the 
cnain  cooe  in  the  previous  figure. 

Patch  corners  are  represented  by  x's  in  Figure  16  ana  they  fall  in 
gnu  centers.  Whac  must  oe  known  is  just  which  patch  corners  are 
insioe  tne  perimeter.  For  convenience,  patch  corners  which  fall  on 
diagonal  perimeter  line  segments  are  counted  as  interior  points. 

The  procedure  is  to  first  obtain  boundary  points  PI,  P2,  P3,  P4,  P5, 
ana  P6,  which  occur  on  vertical  or  diagonal  boundary  segment 
midpoints.  This  can  be  easily  accomplished  with  a  starting  (x,y) 
coordinate  ano  the  chain  code.  These  points  are  then  sorteo 
twice — first  in  y,  then  in  x — to  obtain  the  lists  shown  in  Figure  16. 
The  final  list  is  grouped  in  pairs  (.Pi, P2) ,  ^6^3).  ano 

Ail  Patch  corners  with  x  values  falling  between  these 
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PATCH  CORNER 


iguie  ifa.  Bounoary  points  ano  texture  labels. 


pairs  are  countea  as  being  inside  the  perimeter.  The  result  is  a  list 
of  patch  corners  which  have  the  texture  designation  of  the  perimeter's 
SMC  coGe. 

it  snouio  oe  noted  cnat  this  metnou  always  has  boundary  point  pairs 
anu  nor  single  oounaary  points  oecause  patch  corners  failing  on 
diagonals  are  counted  ana  because  singularities  are  eliminated  curing 
tne  cnain  coue  construction. 

Texrure  Lapels — Once  all  parch  corners  in  the  mission  aata  base 
are  assigneG  texture  laoels,  patch  corners  can  ce  taken  four  at  a  time 
ro  indicate  wnetner  a  patch  is  all  one  texture  or  partly  two.  if  ail 
four  vertexes  have  the  same  iabei,  the  corner  labels  are  aiscaraea  ana 
me  patch  receives  just  one  label  designating  its  texture.  During  the 
mission  simulation,  the  iabei  is  used  as  a  pointer  into  a  fractal 
lookup  table,  allowing  it  to  be  texturea. 

if  one,  two,  or  three  vertexes  have  one  texture  laoel  ana  the  others 
nave  a  different  laoel  ^or  none),  the  corner  labels  are  saved  for  each 
paten,  ana  the  paten  is  given  the  special  title  "texture  border  patch." 

One  final  off-line  procedure  is  necessary.  Every  patch  corner  with  a 
texture  iaoei  is  assigned  a  random  integer  x,  where  -3  -x  ^5.  It  is 
essential  that  this  be  done  to  the  patch  corners  before  they  become 
part  of  a  patch  tree  structure,  so  that  four  patches  sharing  one 
corner  also  share  the  same  ranaom  integer  assignea  to  that  corner,  ana 
so  tnat  fractalea  terrain  appears  continuous. 

3. 2. 2. 2  Real-Time  Terrain  Texture  Generation — During  the  mission  run, 
patches  that  have  a  single  texture  label  will  be  textured  by  the 
fractal  subdivision  method  described  below.  Each  texture  will  have  a 
pointer  into  a  specific  fractal  lookup  table.  Thus,  for  instance, 
water  ana  marsh  will  De  represented  by  two  different  lookup  tables. 

The  number  of  lookup  tables  will  equal  the  numoer  of  textures,  except 
for  special  cases  like  snow  under  certain  weather  conditions,  which 
will  simply  be  assignea  a  high  reflectivity.  A  particular  aovantage 
of  this  methoa  is  therefore  the  low  storage  required. 

Fractals — The  usage  of  the  term  "fractals"  is  much  broader  than 
tne  original  meaning.  Manoelbrot  (1577)  intenoea  fractals  to  stano 
for  self-similar  statistical  functions  wnich  were  nowhere 
air ferentiaole.  In  a  strict  sense,  the  definition  used  here  refers  to 
partly  oifferentiaole  statistical  functions  which  are  not  necessarily 
self-simiiar.  However,  a  less  prosaic  ana  more  useful  definition  is  a 
computer-generated  surface  or  curve  which  employs  linear  recursive 
subdivision  ana  an  LUT. 

A  typical  fractal  LUT  appears  in  Figure  17.  It  can  be  useo  to 
generate  either  fractal  curves  or  surfaces.  The  proceoure  for 
generating  a  fractal  surface  consists  of  generating  several  fractal 
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Figure  17.  Fractal  look-up  table. 


curves  in  parallel  and  combining  them.  The  procedure  for  generating  a 
fractal  curve  along  a  patch  edge  is  outlined  below.  Each  step  >3  in 
the  outline  will  have  a  numerical  example  which  follows  the  LUT  in 
Figure  17  (steps  1  and  2  have  arbitrary  numbers). 

1.  Start  with  the  two  endpoint  elevations  of  the  patch  edge: 

(0,0) 

2.  Add  to  these  corner  elevations  the  random  numbers  assigned  to 
the  corners  off-line:  (-1,2) 

3.  Using  the  new  elevations,  find  the  midpoint  value: 

0  +  (-1)  f  0+2  .  _ 


4.  From  the  LUT  read  out  the  matrix  value  corresponding  to  the 
row-column  pair:  (-1,2)  =  1  (Note  that  (-1,2)  act  as  seeds) 

5.  Aoa  this  value  to  the  midpoint  to  create  a  new  miopoint 
elevation:  1/2  +  1  =  1-1/2 

6.  If  only  two  segments  are  needed  for  display,  then  their 
elevations  are  given  at  their  enapoints:  (-1,  1-1/2,  2)  = 

El>  eM»  e2 

7.  Seeds  used  to  generate  these  elevations  are  always  stored 
with  the  elevations: 
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C'' El  i  Si),  (tMiS*,)),  [(^2  ,  St]^  -  lG  “1 1  ”1 )  i  ( 1-1/2, 1),  ( 2 , 2  H 

o.  Suouiviaing  tne  ieft  section  requires  tne  seeas  (-1,  1;  for 
wnicn  the  correction  factor  is  one.  Steps  3-7  are  continuec 
recursively  oown  to  any  j.evel  oesireo.  At  eacn  step,  the 
correction  factor  can  ue  aivioec  Dy  some  integer  power  of 
two,  so  tnat  at  a  high  level  of  oetaii  extremely  high  slopes 
are  avoioea.  in  general,  wnen  tne  integer  power  equals  the 
levei  of  suooivision  the  fractal  curve  will  De  self-similar. 
However,  other  rules  can  oe  usea  to  generate  arDitrary 
textures,  incluaing  substituting  aosolute  values  of 
correction  factors  for  the  correction  factors  at  given 
suooivision  levels.  Also,  aifferent  kinas  of  LUTs  can  be 
constructea  (.tne  one  usea  in  tnis  stuay  consistea  of  numcers 
ranging  from  -5  to  5,  with  a  Gaussian  Distribution  acout  a 
mean  of  zero;  a  Gaussian  aistnoution  may  not  oe  necessary 
for  many  textures). 

Fractal  surfaces  are  easily  formea  by  constructing  fractal  curves  for 
eacn  paten  eoge  ana  diagonal.  For  instance,  to  suuoivioe  a  paten 
unce,  tne  proceaure  would  be:  Given  corners  A,8,C,D  ana  in  clockwise 
oraer  tne  eeges  AB,  8C,  CD,  DA;  fina  miapoints  ana  correction  terms 
for  each  eoge,  ana  fina  tne  miapoint  ana  correction  term  for  tne 
aiagonai  AC.  These  five  miapoints  plus  tne  four  original  corner 
points  designate  four  new  subpatches. 

Real-Time  Terrain  Texture  Border  Generation— Recall  that  some 
patenes  will  ue  labeled  "texture  border  patches"  off-line  because  some 
of  the  patch  corners  nave  one  texture  label  ana  the  other  corners  have 
another  iaoel.  These  patches  will  be  treatea  with  a  fractal 
subaivision  method  analogous  to  that  just  presented,  but  in  a  more 
aostract  way.  The  purpose  will  oe  to  construct  a  raggea-texture 
ooraer  about  an  area  of  homogeneous  texture.  This  aias  in  realism,  is 
relatively  inexpensive,  and  perhaps  most  significantly,  reouces  the 
number  of  straight  eages  (.hence  aliasing)  in  the  simulation. 

Tne  idea  central  to  the  construction  of  a  rough-texture  Doraer  is  to 
create  a  series  of  interconnecting  patch  border  segments.  Thus,  eacn 
patch  ooraer  segment  must  meet  two  requirements: 

1.  The  doraer  segment  is  rough  ana  statistically  similar  to  ail 
other  border  segments. 

2.  The  boraer  segments  are  continuous  from  patch  to  patch, 
giving  tne  appearance  of  one  continuous,  closed  ooraer. 

Doth  these  requirements  can  be  met  by  the  application  of  fractal 
subaivision  to  texture  boraer  patches.  As  a  heuristic  aio,  consider 
tne  ooraer  patch  in  the  top  of  Figure  18.  Each  corner  has  a 
particular  texture  laoel  ana  a  particular  random  integer  x,  where  -54 
x  4  5.  These  labels  ana  numbers  will  serve  to  generate  three  fractal 
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s^naces  in  paraiuei  corresponaing  to  tne  one  paten.  One  surface  will 
oc  tne  arass  surface  ana  tne  secona  a  cock  surface,  each  creacea 
cnaugn  not  necessarily  aispiayea  over  tne  entire  paten.  Tne  tnira 
rractaj.  surface  is  not  aispiayea,  it  is  constructea  with  so-callec 
"faj.se  elevations"  ana  is  usea  only  to  aelimit  the  oorGer  oetween 
grass  anu  roc*  surfaces.  This  is  accomplished  oy  assigning  a  zero 
raise  eievation  to  one  texture  laDei  ana  an  elevation  of  10  to  the 
otner  lit  ooes  not  matter  which  is  which  as  long  as  it  is 
consistent;.  Aooing  fractal  perturoations  to  this  tiiteo  surface 
auring  fractal  subdivision  will  sometimes  result  in  suppatches  with 
corners  having  elevations  >5  and  at  other  times  <5.  In  the  former 
case  isee  Figure  IS),  the  subpatch  corner  is  aesignateo  with  an  R  = 
rocK  coae  ana  in  tne  latter  case,  a  G  =  grass  coae. 

it  is  important  to  note  that  the  level  of  suboivision  of  all  three 
patenes  is  always  the  same,  but  that  eacn  patch  has  its  own  fractal 
iooK-up  taDie,  so  that  the  initialized  ranoom  integers  sharea  by  the 
three  patches  proauce  three  different  textures. 

Two  real  elevations  are  computea  ana  availaoie  for  each  subpatch 
corner.  Depending  on  the  false  elevation  value,  one  of  the  real 
elevations  corresponaing  to  one  of  the  textures  is  chosen.  When  these 
elevations  are  eventually  used  for  display,  suppatches  containing 
corner  elevations  from  both  textures  will  have  intensities  assignea 
accoraing  to  an  average  of  texture  reflectivities  ana  hues,  or  just 
one  aominant  reflectivity  ana  hue;  the  final  arbitrator  will  be 
visual  tests  of  DMA  texture  border  pairs. 

it  shoula  be  noteG  that  even  when  a  patch  or  subpatch  has  elevations 
from  different  textures'  LUTs,  surface  continuity  is  preserveo;  that 
is,  no  gaps  appear.  Furthermore,  the  LUT  usea  for  boraer  construction 
may  leaa  to  vastly  different  boraers  depending  on  the  nature  of  the 
LUT.  Some  LUTs  may  lead  to  fairly  smooth,  curved  borders,  others  to 
extremely  raggea  boraers.  Many  will  lead  to  splotchy  borders,  which 
consist  of  many  small,  isolated  clumps  of  one  texture  that  graaually 
evolve  into  clumps  of  the  isolated  adjacent  texture,  so  that  no 
aistinct  boraer  exists.  This  last  case  is  controlled  by  the  choice  of 
the  initial  false  elevation,  which  neea  not  be  10  (ana  is  quite 
arbitrary;,  oy  the  LUT  structure,  ana  by  the  division  factoi  for  each 
level's  fractal  correction  term.  Finally,  ana  briefly,  the  very  rare 
cases  wnere  three  or  four  textures  fall  on  one  patch  can  be  treateo  by 
aooing  aaaitional  false  elevation  patches  computed  in  parallel,  or  by 
arbitrarily  eliminating  them  during  the  off-line  preparation. 

Texture  Border  Smoothing — In  some  isolated  cases  realistic  borders 
will  be  gradual  rather  than  aistinct;  for  example,  marsh  to  water. 
These  cases  can  be  treated  by  a  more  sophisticated  boraer  algorithm, 
in  which  the  values  of  false  elevations  are  usea  as  weights  to  apply 
more  of  one  texture  than  another.  Thus,  adjacent  textural  hues, 
saturations,  ana  reflectivities  coula  merge  gradually  accoraing  to  the 
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r cise  surface  elevations.  Tnis  procedure  would  consume  little  time 
uecause  of  its  isolated  application  anu  sc  it  is  excluded  from  an 
operations  analysis. 

Texture  napping — Storing  a  file  of  an  image  ano  mapping  it  to  a 
surface  is  a  particularly  easy  way  to  texture  doth  terrain  ano 
cultural  ooject  surfaces.  For  application  with  terrain  patches  which 
can  he  projected  to  screen  space  at  arbitrary  levels  of  suDdivision,  a 
tree  structure  is  required  to  store  the  textural  image  at  many  levels. 

There  are  two  defects  to  this  technique:  1)  for  large  areas  it 
requires  tremenoous  storage,  ana  2)  only  a  finite  amount  of  detail  can 
be  stored.  As  a  consequence,  close  surfaces  will  appear  blocky — or  if 
averagea  or  smoothed,  unrealistic  and  blurry. 

On  the  other  hano,  for  large  areas  requiring  large-scale  texture  only, 
texture  mapping  is  recommended.  The  best  example  of  this  circumstance 
is  where  large  rectangular  agricultural  areas  are  present.  In  such  a 
case,  a  patch  or  even  several  patches  will  be  assigned  a  certain  hue, 
saturation,  ana  reflectivity  to  simulate  the  crop  grown  there.  These 
assignments  must  be  maae  off-line  on  the  basis  of  photographic/ 
statistical  information  for  the  regions  in  question.  No  specific 
methooology  is  suggested  here. 

Texture  mapping  is  best  appliea  to  certain  objects.  For  example,  a 
roof  of  a  house  can  have  a  small  texture  map  with  few  branches  in  its 
tree  oecause  the  house  is  inevitably  only  a  few  pixels  or  tens  of 
pixels  across.  Such  maps  can  be  accessea  for  many  objects 
simultaneously;  for  example,  a  hundreo  houses  in  one  FOV  would  have 
pointers  to  only  one  texture  map.  Thus  storage  is  minimized. 

Finally,  texture  mapping  to  cultural  surfaces  should  only  be  attempted 
if  aDSOlutely  necessary  for  pilot  recognition. 

Vioeo  Texture — At  the  time  of  this  writing,  viaeo  texture 
techniques  have  been  tested  successfully  in  a  non-real  time  moae  at 
Honeywell,  but  it  is  not  known  whether  such  techniques  can  be  applieo 
in  real  time  at  a  reasonable  cost.  Stuoies  are  currently  under  way  to 
answer  this  question.  Assuming  that  video  texturing  techniques  are 
feasible,  tney  have  the  following  potential  applications: 

1.  The  distant  sky  can  be  representeo  by  a  rotated,  translated 
photograph  representing  any  sky  conaition,  including  night 
skies  with  real  star  positions. 

2.  Inoiviaual  objects  can  be  modeled  by  rotated,  transiateo,  ana 
magnified  photographs  of  the  objects  themselves.  A  single 
tree,  for  example,  coula  be  represented  by  two  photographs: 

a  side  view  and  a  top  view.  One  view  would  gradually 
metamorphose  into  the  other  (faae  m/faae  out)  as  tne  pilot's 
orientation  above  the  tree  changed. 
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3.  surfaces  uf  large  extent  can  be  synthesized.  For  example,  an 
entire  sky  of  clouos  would  oe  generated  oy  a  perspective  view 
of  one  photograph.  Similarly,  terrain  roaos  couia  be 
overlaid  on  the  terrain  surface  by  mapping  a  perspective^ 
correct  roao  image  to  the  simulator  screen. 


3.Z.2.3  Texture  Off-Line  Operations — 


Determine  Perimeter-Gna  Intersections: 


a.  Given  segment  endpoints,  fine  slope,  intercept:  3s*,  lc,  lm 
per  segment  x  N;  N  =  number  of  segments  in  a  oerimeter 
o.  determine  horizontal  ano  vertical  grid  lines  which  will  oe 

intersected:  2P  compares,  where  P  =  length  of  perimeter  in  grio 
units 

c.  Fino  perimeter-grio  intersections:  (2m,  2a)  x  P 
o.  Sort  intersections  (merge):  P  compares 

2.  Determine  nearest  grid  corners:  2P  compares 


3.  Form  chain  cooe:  2P  compares 

4.  Remove  singularities:  P  compares 

5.  Check  for  closure:  number  of  adds  roughly  =  2  numoer  of 
entries  in  chain  code  list  2P  aoas. 


6.  Find  oounaary  points  (easiest  way  is  to  save  coordinate  pairs 
from  step  2  ano  find  midpoints  according  to  chain  code)  (la, 

1  shift  x  2  per  boundary  point  x  number  of  boundary  points 
Pa,  Ps 

7.  Sort  (x,  y);  quicksort  on  two  keys:  n  log  n  x  2  compares 
where  n  P 


6.  Designate  texture  for  patch  corners:  1  operation  (aoo)  per 
patch  corner  x  number  of  patch  corners  =  area  of  textured 
region  x  la 

9.  Assign  texture  labels  to  patches:  3  compares  per  patch  x 
area  of  texture 


10.  Assign  random  numbers  to  patch  corners:  1  assign  per  vertex 
x  area  of  texture 

With  a  textureo  area  of  perimeter  P,  area  A,  ano  number  of  perimeter 
segments  N,  tne  totai  number  of  operations  is: 


*s  =  subtract,  m  =  multiply,  a  =  aoo,  d  =  divide 
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;>h  subtracts 
im  uiviues 
n  multiplies 
oP  +  zP  log  P  compares 
6P  aoas  +  P  shifts 
c?  multiplies 
P  snifts 
A  aaas 
jA  compares 
A  assignments 

Equating  computation  times  for  compares,  aaas,  assignments,  shifts, 
ana  suotracts  to  0.3&  ysec,  multiplies  to  11.2  ysec,  ano  aiviaes 
to  14  ysec,  tne  amount  of  time  requirea  is: 

1.9A  ysec  +  26.34N  ysec  +  0.76  ysec  ;8P  +  P  log  P)  +  22. 4P  ysec 

A  typical  texturea  area  might  tie  several  kilometers  in  extent,  for  which 
the  following  is  chosen: 

A  =  5  km^  =  300  in  100-meter  size  units 
P  =  i2  km  =  120  in  100-meter  increments 
N  =  15  segments 

The  off-line  time  to  compute  textural  information  for  one  area  is  then: 

500(1.9  x  10"6)  +  (26(15  x  10-6)  +  0.76  x  10"6(960  + 

120(2) ) 

+  22.4  x  10~6(120)  =  5  x  10-3  sec 

Thus  for  a  mission  aata  oase  containing  even  thousands  of  textures, 
the  preparation  time  is  brief. 

3. 2. 2. 4  Real-Time  Operations  to  Produce  Texturea  Surface 
Patches — Adaing  fractalea  texture  to  a  surface  patch  involves  a 
recursive  subdivision  procedure.  Each  subdivision  requires: 

5  table  look-ups  | 

5  shifts  >  times  approximately  106  subdivisions  per  frame 

10  aaas  J 

Fractal  subdivision  architecture  is  describee  in  Figure  19. 

Alternative  texturing  techniques  are  aiscussea  in  Appeaix  B;  the 
question  of  using  image  space  vs  object  space  is  discussed  in  Appendix 
c. 

3.2.3  Terrain  and  Hyoroqraphic  Features:  Surface  Representation 

The  purpose  of  the  Honeywell-Catmull  algorithm  is  to  create  a 
parametrically-oefinea,  continuous,  curved  surface  which  closely 
follows  the  discrete  terrain  elevation  samples  in  the  DMA  aata  base. 
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lne  oata  uase  gives  elevations  at  uniform  gric  intervals.  Estimates 
of  intervening  elevations  are  neeoeo  for  two  reasons: 

1.  To  compute  tne  perspectiveiy  correct  screen  position 

To  compute  the  surface  normal,  wnicn  is  usea  in  tne 
illumination  mooel  to  compute  intensity 

The  methoo  for  estimating  the  intervening  elevations  is  essentially 
Catmuli's  ( 1974J  methoo.  He  fits  a  bicuoic  spline  surface  to  the 
sample  elevations. 

It  is  quite  time-consuming  to  aetermine  elevations  from 
straightforwara  suostitution  into  a  bicuDic  equation,  so  Catmuil 
ueviseo  a  fast  technique  which  recursively  aiviaes  patches  in  half  in 
latitude  ana  longituae  ana  fines  the  elevations  by  a  clever 
combination  of  aaa,  subtract,  ana  shift  operations.  Remember  that  the 
reason  for  subaividing  is  to  get  an  elevation  estimate  for  a 
oispiayable  piece  of  the  terrain. 

3. 2. 3.1  Methoo  Outline — 

I.  Just  as  a  flat  surface  can  be  constructed  from  many  contiguous 
rectangles,  define  the  entire  curvea  terrain  surface  as  a 
collection  of  many  contiguous,  curved  "surface  patches." 
(Technically  this  is  callea  a  spline  surface.) 

II.  Prepare  the  surface  patches  so  that  they  can  be  divided  into  four 
subpatches;  as  can  each  subpatch,  recursively;  aown  to  any  level 
necessary . 

III.  Each  frame  time,  patch  vertexes  are  perspectiveiy  transformed  to 
the  "screen  space"  of  the  pilot.  (A  "window"  which  corresponds  to 
this  screen  must  be  constructed;  see  Figure  20). 

IV.  A  rectangle  is  constructed  to  enclose  the  patch  vertexes.  The 
rectangle  iies  in  a  plane  defined  by  the  screen  coordinates  (xs, 
ys,  zs  =  OJ;  see  Figures  21  ana  22. 

V.  If  the  rectangle  for  any  patch  is  pixel  size  or  smaller,  the  pixel 
associated  with  the  rectangle  is  given  an  intensity  which  aepends 
upon  the  relative  patch,  pilot,  ana  sun  orientations,  in  aaaition 
to  the  texture  ana  shaaow  assigned  to  the  patch. 

VI.  If  the  rectangle  is  larger  than  pixel  size,  the  corresponding  patch 
Un  worla  coorainates)  is  aivioed  into  four  subpatches.  Each 
subpatch  vertex  then  unaergoes  a  perspective  transformation  to 
screen  space,  with  rectangle  tests  ana  subaivision  occurring 
recursively  until  all  rectangles  are  approximately  pixel  size. 

These  tests  occur  each  frame  time. 

Vil.  When  the  orientation  of  a  patch  or  subpatch  surface  is  facing  away 
from  the  pilot,  the  patch  or  subpatch  is  oiscaroeo. 

VIII.  when  the  enclosing  rectangles  of  two  patches  overlap,  the  area 
closer  to  the  pilot  is  displayed. 
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Figure  20.  Terrain  imaging  geometry. 
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Figure  21.  Patch  size  test 


IF  THE  RECTANGLE  IS  TOO  LARGE. 
THE  PATCH  IS  OIVIOED  INTO  FOUR 
SU8PATCHES  AND  THE  VERTICES  OF 
EACH  OF  THE  SUBPATCHES  ARE 
PROJECTED  TO  SCREEN  SPACE. 

EACH  SUBPATCH  IS  ENCLOSED  BY  A 
RECTANGLE.  AGAIN.  IF  THE 
RECTANGLE  IS  TOO  LARGE,  THE 
SUBPATCH  IS  DIVIDED  ANO  THE 
VERTICES  PROJECTED.  IF  THE 
RECTANGLE  IS  APPROXIMATELY 
PIXEL  SIZE.  THE  PIXELS  ARE  GIVEN 
APPROPRIATE  INTENSITIES. 

DIVISION  TO  PIXEL  SIZE  ENSURES 
CONTINUITY  OF  INTENSITIES 
ACROSS  THE  SURFACE. 
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Figure  22.  Patch  too  big. 


The  above  aescription  is  intenaea  only  to  provide  a  rough  iaea  of  the 
framework  of  the  surface  representation  algorithm.  A  detailed 
aescription  follows. 

1.  After  the  DMA  elevations  for  the  mission  area  are  obtained, 
they  must  be  accessed  in  groups  of  16  adjacent  elements  ana 
placea  in  4  x  4  matrixes.  Each  group  of  16  elevations  is 
useo  to  generate  a  curvea  Dicubic  surface  patch  whose  borders 
are  defined  oy  the  central  four  elevations  among  the  16. 

This  is  illustratea  in  Figure  23.  Note,  in  generating  an 
adjacent  patch,  that  of  the  16  elevations  applied  in  its 
construction,  12  are  reaunaant  from  the  previous  patch. 

2.  The  mathematical  equation  of  a  bicubic,  Elevation  = 
a^u^v-5  +  aou-^v2  +  ...,  is  entirely  specifiea  by 
its  16  coefficients  ai , a2, . . -bi ,b2, • . .c^ , 

...03,04.  Different  kinds  of  Bicubic  surfaces  can  be 
manufactured;  that  is,  aifferent  coefficients  determined, 
uepenoing  on  what  we  ao  with  the  elevations.  To  ensure 
elevation,  first,  and  secono  derivative  continuity  across 
patch  boroers,  a  so-calleo  B-spline  matrix  is  applied  to  the 
elevation  matrix.  The  specific  operation  is  aescribeo  in 
Figure  24. 
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Figure  23.  Bicubic  patch  ana  its  aetermining  elevations. 

The  matrix  M  in  Figure  24  is  for  B-spline  basis  functions. 

It  ensures  that  across  all  patch  boroers  there  is  elevation 
ano  first  ana  second  aerivative  continuity.  It  is  possible 
to  construct  patches  with  other  matrixes.  Some  are 
interpolating,  otners  are  approximating.  The  B-spline 
approximates  the  control  points  but  aiso  provioes  more  local 
control  than  any  other  approximating  basis. 

It  is  important  to  realize  that  the  bicubic  representation  is 
the  lowest-oraer  polynomial  representation  of  a  free-form, 
curvea,  continuous  surface.  Lower-oraer  polynomials  do  not 
ensure  first  or  secona  aerivative  continuity  at  patch  borders. 

3.  Succeeaing  the  construction  of  a  coefficient  matrix,  the 

coefficients  are  combinea  into  "register  squares."  There  are 
four  register  squares  per  patch,  one  for  eacn  corner.  Each 
register  square  contains  four  numbers;  for  example,  at  the 
corner  u  =  0,  v  =  1  the  four  numbers  are  (a^  +  02  +  Oj, 

+  Q4) ,  lu 1  +  D2  +  bj  +  ,  (3a^  +  02)  and 

(3bj_  +  o2). 
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1.  Place  16  elevations  in  a  4  x  4  matrix  E.  The  16  elevations  come  from  the  data  base  and  therein  are 
arranged  in  a  4  x  4  matrix. 

2.  Using  a  cubic  B  splme  matrix  M,  compute  MEM^  where  T  means  transpose. 
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forms  a  coefficient  matrix: 


1 

0 

0 

0 


MEM 


T  , 


l  1 


“2 


a3 

"3 

c3 


a4 

b4 

c4 

<*4 


Compute  register  square  values  for  each  patch  corner.  A  register  square  has  four  values,  initially 
computed  from  the  coefficient  matrix,  subsequently  computed  by  subdivision. 


u=0  v*1 


d1  +d2  +d-j  +  d4 

b1  +b2  *b3  +b4 

3d,+d2 

3b  j  ♦  bj 

u=1  v=1 


(sum  of  all 
coefficients) 

3(a1  +  »2  +  *3  +  a4* 
+(b^  +  b2  +  bj  +  b$) 

3(0^  +  b^  +0^  +  d^) 
+(a2  +  b2  +  c2  +  d2) 

3(3»t  +  b,) 

+  3a2  *  b2 

PATCH 


u=Q  v*0 


u=1  v=0 


*4  +  b4  +  c4  +  b4 

3*4 +  b4 

>2  +  bj  +  C2  +  dj 

3a2  +  b2 

Figure  24.  Making  register  squares. 
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Kegislei  squares  fGrm  the  core  of  tne  Latnai*  solui . * _ r  a-goritnm. 

Tne  iaea  is  co  start  with  oniy  tne  pater,  coiner  elevations  ana  seme 
correction  terms,  tnen  aetermine,  oy  a  recursive  piuceoure  \ aiong  tne 
rour  paten  eages  ana  in  its  center;,  miupoints  tnat  i.ie  on  tne  oicuoic 
surface.  6y  continually  oetermining  miapoints  for  eacr,  suopaten,  tne 
collection  of  elevations  ootaineo  can  serve  to  approximate  the  curvea 
uicuoic  surface. 

tacn  register  square  contains  one  corner  elevation  ana  tnree 
correction  terms.  Suoaiviaing  a  patch  into  four  suopatches  implies 
turning  four  corner  elevations  into  nine  corner  elevations  ano 
iiKewise  four  register  squares  into  nine  register  squares.  This 
process  is  uiagrammea  in  Figure  23.  The  elevations  requirea  at  each 
level  of  suoaivision  are  always  in  the  upper  left  corner  of  the 
register  square. 

3. 2. 3. 2  Tree  Structure — Tnere  are  actually  two  Distinct  tree 
structures  in  the  terrain  display  algorithm,  one  storea  ana  one 

c omputea.  The  storea  tree  is  the  mission  data  base.  It  consists  of 
the  data  necessary  to  aisplay  large  surface  areas,  extending  from  the 
mission  aata  base  root  noae  itself  aown  to  inaiviaual  bicubic  patch 
corners.  The  lowest  noaes  or  terminal  nooes  in  the  storea  tree  are, 
therefore,  bicubic  patches. 

The  computational  tree  consists  of  the  data  necessary  to  display 
smaller  surface  areas,  where  the  root  noaes  are  the  bicuoic  patch 
terminal  noaes  of  the  stored  tree.  Lower  nodes  in  the  computeo  tree 
are,  as  the  designation  implies,  computed  Uf  necessary)  oy 
recursively  subdividing  the  root  paten  into  small  subpatches. 

The  computatianai  tree  is  scanned  in  depth  first-order;  that  is,  the 
algorithm  steps  through  the  tree  node  to  node,  beginning  at  the  top  or 
root  noae.  Noaes  near  the  top  represent  large  grouna  areas  wnose 
projections  on  the  display  screen  will  depeno  on  orientation  ana 
aistance  from  the  pilot's  viewpoint.  Projections  of  nearby  noaes  will 
usually  cover  many  pixels,  forcing  a  scan  to  a  greater  depth  for  such 
noaes.  Distant  noaes  will  project  to  smaller  picture  areas,  ana  the 
scan  depth  wili  be  less.  This  feature  allows  an  automatic  selection 
of  level  of  aetail  as  well  as  minimizing  the  computational  effort  in 
proQucing  a  picture. 

3. 2. 3. 3  Picture  Generation — The  proceaure  for  generating  a  picture  is 
as  follows.  Starting  with  the  top  node,  the  picture  area 
corresponding  to  the  node  is  ceterminea  by  projecting  the  four  corners 
of  the  patch  represented  by  the  node  to  display  screen  coordinates.  A 
aecision  is  mace  to  terminate  the  scan  at  that  node  or  proceed  to  the 
next  level.  Termination  can  occur  under  the  following  conaitions: 

1 .  When  the  projected  area  represented  by  the  node  falls  outside 
the  aisplay  window 

2.  When  the  projected  area  is  small  enough  to  display 
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Tne  rescue  or  any  of  these  conditions  is  to  terminate  tne  scan  at  tnat 
nooe  ana  aiscara  aii  oranenes  oeiow  the  noae  at  wnich  termination 
occurrea.  we  can  immeaiateiy  compute  tne  proper  intensity  using  tne 
texture,  snaoow,  ana  illumination  moaeis  uescrioea  eisewnere  in  tnis 
report. 

Projected  patenes  form  polygons  in  screen  space.  These  polygons  will 
oe  enciosea  oy  rectangles  ana  the  suopixels  covereu  by  each  rectangle 
will  oe  assignea  the  patch  inter, sity.  Tne  approximation  of  coloring  a 
screen  oy  enclosing  rectangles  ratner  than  oy  the  polygons  themselves 
nas  three  justifications: 

1.  it  allows  tne  use  of  a  compact,  quick  computation  when 
uetermining  exactly  wnich  suopixeis  are  coverea  by  a 
rectangie . 

2.  It  avoios  losing  "bow  tie"  polygons;  that  is,  if  tne  surface 
normal  calcuiatea  for  a  dow  tie  faces  away  from  the  observer, 
the  polygon  will  not  be  aisplayeo.  Droinarily,  a  hole  will 
appear  in  tne  picture  oecause  of  tnis  error.  By  empolying 
enclosing  rectangles,  the  overlap  from  rectangles  aajacent  to 
the  oow  tie  will  cover  any  potential  hoies  (see  Figures  26a 
ano  26c) . 

3.  It  avoios  holes  from  the  projection  of  aajacent  patenes  wnich 
are  suoaiviaea  to  aifferent  levels  (see  Figure  26a). 

Some  time  may  be  savea  oy  comparing  the  relative  lengths  of  polygon 
siaes  ana  subaiviaing  only  the  longer  aimension.  For  example,  in 
Figure  26b  if  L1/L2  were  greater  than  two.  only  the  siaes  Li  ana  l3 
wouia  be  suDaiviaea.  This  process  may  also  be  desirable  because  oy 
creating  polygons  of  more  or  less  equal  dimensions  on  all  siaes,  their 
enclosing  rectangles  will  more  accurately  reflect  the  polygon 
dimensions;  ana  less  time  will  be  spent  replacing  z-Duffer  memories 
because  of  reaucea  overlap  among  the  rectangles.  An  investigation  of 
this  proceoure  in  quantitative  aetail  was  not  performed  as  part  of 
this  stuay ,  thus  a  recommendation  of  its  use  is  left  open. 

After  a  patch  projection  on  the  screen  has  been  reaucea  to  pixel  size, 
it  is  tempting  to  try  to  save  some  time  by  determining  those  patches 
that  face  away  ana  discaraing  them  to  avoia  intensity  calculation  for 
those  surfaces.  This  can  be  accomplished  by  taking  the  oot  proauct  of 
tne  "eye  vector"  with  the  surface  normal  vector  of  the  patch.  If  the 
oot  proauct  is  negative,  the  surface  faces  away  from  the  observer. 

Such  a  test  was  not  implementea,  for  two  reasons: 

1.  There  are  occasions  when  there  are  no  surfaces  facing  away. 

In  such  cases  the  test  is  of  no  use  ana  in  fact  becomes  a 
liability.  Thus  the  test  is  of  no  value  in  lessening  the 
numoer  of  intensity  calculations  in  the  worst  case:  fiat 
terrain  filling  the  FOV  out  to  the  horizon. 


64 


2.  Most  terrain  will  oe  mooeiea  with  a  Diffuse  reflectance  tern 
oniy,  because  it  is  perceptually  adequate.  Tnus  tne  specuiar 
tern  requiring  tne  act  product  of  eye  ana  surface  normal 
vectors  win  oe  a  rarity.  It  follows  that  tne  special 
computation  of  tms  oot  proauct  for  surfaces  facing  away  will 
oe  time-consuming,  requiring  a  new  normalizeo  eye  vector  ana 
uot  proauct  each  frame  time. 

Figure  27  summarizes  the  suoaivisi on  ana  aisplay  algorithm. 

3. 2. 3. 4  Display  Alqoritnm  Benefits  ano  Drawbacks  — 


Benefits — 

1.  Because  oicucic  B-spiine  surfaces  represent  tne  terrain 
surfaces,  real-woria  contcurs  are  moaelea  more  accurately 
tnan  with  polygons. 

2.  No  sorting  is  requirea  to  determine  patch  maxima.  This 
avoias  numerical  techniques  wnich  occasionally  incur 
singularities. 

3.  Bicubic  ana  fractal  subdivisions  are  logical  extensions  of 
the  mission  quad  tree  subdivision.  The  transition  from  the 
stored  quad  tree  to  the  computed  quad  tree  can  be  transparent 
to  the  algorithm  implementation.  This  provides  a  unifiea 
approach  ano  a  clear  flow  of  logic  from  the  root  nooe  to  the 
smallest  aisplayable  subpatch. 

4.  Fractal  subdivisions  used  for  textures,  texture  borders,  ana 
snaaow  boraers  can  be  computea  in  parallel  with  bicubic 
subdivision,  aading  no  time  to  the  display  algorithm. 

5.  The  overall  algorithmic  approach  is  unified  because 
subdivision  is  applied  to  obtain  smooth  curveo  surfaces, 
irregular  textured  surfaces,  texture  boraers,  shaaow  borders, 
ana  appropriate  pixel  size  resolution  for  terrain  ana 
cultural  objects. 

6.  Fractal  texturing  proviaes  an  arbitrary  ano  automatic  level 
of  detail  while  maintaining  the  macroscopic  identity  of  a 
texture. 

7.  A  z-Duffer  is  used  to  solve  the  hiaaen  surface  problem. 

Other  techniques  need  to  sort  lists  of  entities  to  solve  the 
hidden  surface  problem.  The  sorting  can  become  a  major 
factor  in  real-time  consiaerations,  limiting  the  number  of 
polygons  or  patches  that  are  sortea. 

8.  Each  specializea  technique  can  be  flexibly  implemented. 

Thus,  shadows  can  be  applied  or  withhela;  cultural  objects 
can  be  aaaed  or  withheld;  and  textures  may  or  may  not  be 
applied  in  any  part  or  all  of  the  data  base. 
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Figure  17.  SuDaivision  ana  display  algorithm. 
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>.  Off-line  preparation  of  tne  oata  Dase  for  register  squares 
anc  texture  is  independent  of  the  mission;  that  is,  the 
preparation  is  inoepenoent  of  the  sun  position.  Off-line 
preparation  can  oe  nanalea  quicKly  because  the  affine 
transformation  is  aireaoy  in  part  of  the  real-time 
perspective  transformation  hardware. 

10.  The  nature  of  the  suoaivision  process  allows  us  to  avoid  the 
cioss  ana  uot  products  taken  for  tne  surface  normal  vector 
ana  aiffuse  intensity  ana  employ  ino'eaa  a  simpler  a aa  ano 
shift  process. 

11.  Bicubic  ana  fractal  subaivision  processes  are  very  quick, 
using  only  aaa,  subtract,  ano  shift  operations. 

urawoacks — 

1.  Anti-aliasing  is  difficult  Decause  the  surfaces  which  must  be 
usea  in  anti-aiiasing  Decome  available  at  different  times. 

2.  As  a  patch  is  subaiviaea,  the  space  requirements  grow  rapialy 
for  storing  register  squares.  Adjacent  patches  with  common 
corners  must  have  separate  register  squares  because  the 
squares  will  contain  values  representing  different  levels  of 
subdivision. 

3.  The  cubic  surface  may  not  be  appropriate  for  all  surfaces. 
Flat  surfaces  may  be  rendered  with  slight  undulations  aue  to 
adjacent  patches  wnich  have  some  curvature. 

3. 2. 3. 5  Hyoroqraphic  Surfaces — Bicubic  patches  form  a  continuous 
surface.  Wnen  water  surfaces  meet  land,  however,  there  is  generally  a 
discontinuity,  if  this  is  aeterminea  to  be  perceptually  important,  an 
inexpensive  methoa  is  available  to  moael  the  discontinuity.  For  those 
patches  containing  water-land  boroers,  two  register  squares  can  be 
storea,  one  for  a  flat  water  surface,  the  other  for  the  terrain 
surface.  In  analogy  with  the  texture  Doroer  Determination  methoa,  the 
elevation  appropriate  to  the  texture  (water  or  lano)  can  be  assignee. 
Thus,  in  this  special  case,  two  bicubic  surfaces  are  subaivioed  in 
parallel  ana  the  elevation  chosen  for  display  will  be  contingent  upon 
tne  texture  chosen  for  aisplay. 

3. 2. 3. 6  Clipping — Clipping  cultural  objects  or  terrain  surfaces  not 
appearing  in  the  FGV  is  accomplishea  in  two  separate  stages  auring  the 
suoaivision  process,  ana  one  just  before  subaivision.  For  each  frame 
time,  a  circular  area  surrounding  the  viewer  and  contained  in  a 
nigh-speea  memory  is  available.  From  this,  a  particular  slice 
slightly  greater  than  60°  is  taken. 

A  typical  slice  might  contain  50,000  patches;  of  these  only  40,000 
are  suoaividea.  When  a  patch  is  projected  to  screen  space  for  the 
first  time,  a  rectangle  surrounding  the  patch  will  be  used  for 
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Clipping.  If  any  part  ot  tne  rectangie  intersects  the  screen,  tne 
Patch  is  induced  in  tne  rest  of  the  suDQivision  anG  perspective 
transformation  process,  if  no  part  intersects  the  screen,  the  patch 
is  oiscaroeo.  To  accommoaate  higniy-curvea  patches,  tne  rectangie 
snouio  ue  slightly  larger  tnan  the  ooraers  aefinea  by  the  patch 
vertexes. 

wnen  a  patch  is  finally  subaiviaea  to  pixel  size,  an  intensity 
calculation  is  carriec  out  only  if  the  rectangie  enclosing  tne  patch 
can  oe  assignea  to  a  screen  pixel;  if  not,  it  is  excludea.  Thus,  the 
tmra  stage  of  dipping  is  not  a  separate  process  but  simply  falls  out 
of  the  process  of  assigning  polygon  intensities  to  screen  pixels. 

5.2. 3. 7  Terrain  ana  Hyarograpnic  Operations — There  are  two  matrix 
multiplies  wnicn  must  occur  in  the  off-line  aata  preparation  to 
generate  eacn  oicuoic  coefficient  matrix.  The  operations  for  this  are 
126  multiplies  ana  So  aaas.  The  oicubic  coefficients  must  be  usea  to 
generate  register  square  values.  This  takes  an  aaaitional  nine 
multiplies  ana  40  auas.  The  total  number  of  multiplies  is  137  ano  the 
numoer  of  aaas  is  136.  This  number  is  linearly  proportional  to  the 
size  of  the  mission  cate  case. 

For  a  typical  minicomputer  a  multiply  time  is  11.2  psec  ana  an  ada 
time  is  0.36  usee.  Allowing  one  msec  input/output  time,  the  total 
time  to  generate  one  register  square  is  2.59  msec.  With  5  x  106 
register  squares  (the  assumea  mission  area),  3.6  hours  of  computer 
time  is  requirea.  In  the  on-line  moae,  the  item  of  interest  is  the 
bicubic  subaivision  of  each  terrain  patch.  For  this  mission  area, 
there  will  be  1.7  x  106  subdivisions  per  frame.  This  is 
accompiishea  using  real-time  pipelined  haroware,  as  shown  in  Figure 
5.  See  Appenaix  D  for  a  aiscussion  of  other  surface  representation 
axgontnms. 

3.2.4  Object  Representation 

All  the  previous  texture  techniques  treated  texture  as  a  pattern  in 
which  inaiviaual  objects  are  not  treated  separately  but  as  a 
collection.  This  allows  the  pattern  to  be  represented  in  a  more  or 
less  aoequate  ana  timely  fashion  when  viewed  from  a  distance,  hone  of 
the  previous  techniques  were  appropriate  for  near-aistance  views,  in 
this  subsection,  several  methoas  are  discusseo  for  representing 
inaiviaual  objects.  The  thesis  is  that  a  texture  pattern  is  an 
aggregation  of  individual  objects.  As  one  comes  nearer  to  a  pattern, 
the  pattern  should  break  up  into  discernible  objects.  The  original 
pattern  may  tnen  actually  disappear  and  be  replaced  by  distinct 
objects.  These  have  their  own  internal  patterns  that  might  be 
represented  by  the  techniques  previously  described. 
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Tr.e  cecnniques  to  oe  presentea  neie  are  of  two  types.  The  first  uses 
viuuo  ooject  images.  This  is  a  version  of  mapping  auapteo  to 
individual  ooject  representation.  The  secono  is  ooject  synthesis,  in 
wmcn  wen-known  snapes  like  circles  ano  rectangles  are  perturDeo  ana 
textureo  to  represent  the  internal  patterns  in  the  oujects  synthesizea 

3.4.4. 1  images  for  doject  Representation — Representation  with  images 
uses  ooject  images  storeo  on  viaeo  aiscs  for  superposition  on 
surfaces.  The  ioea  merges  the  control  ana  surface  representation 
offered  uy  traaitionai  computer-generatea  imagery  (CGI)  tecnniques 
with  the  high  fidelity  offerea  oy  viaeo  technology.  The  speeo  with 
wmcn  a  scene  can  De  filled  with  hign-fioeiity  objects  is  mucn  faster 
than  with  traaitionai  uGI  ooject  repiesentation  because  the  oetails  of 
tne  objects  ao  not  have  to  be  generated  individually . 

The  control  provided  oy  surface  specification  ana  ooject  placement  in 
a  uniform  grid  can  oe  fruitfully  comoinea  with  the  high  fidelity  of 
ooject  photographs  ano  computer  access  to  video  discs.  Objects  can  be 
positioneo  on  the  modeled  terrain  both  manually  ana  automatically. 
Photographs  of  objects  can  be  stored  ana  categorized  according  to 
type,  aspect,  size,  ana  nearest  point  for  display  on  video  disc. 

Once  the  computer  has  a  list  of  object  locations  and  sizes,  the 
oojects  can  be  extracted  automatically  from  the  video  disc.  Note  that 
tne  object  to  be  extracted  must  be  specified  by  size,  distance  from 
viewer,  aspect,  ano  type  of  object.  Pictures  can  be  stored  of  objects 
representing  the  closest  distance  from  the  viewer  for  which  that 
picture  is  approoriate.  Then,  when  a  more  long-range  view  is  needed, 
the  image  can  be  digitally  shrunk. 

Object  priority  (hidden  surface  resolution)  can  be  solved  by  using  the 
z-ouffer  approach.  This  means  that  every  pixel  will  have  a  distance 
ana  intensity  associated  with  it.  When  an  intensity  is  to  be  assigned 
to  a  pixel,  the  distance  to  the  associated  object  is  compared  with  the 
distance  to  the  object  already  covering  the  pixel.  If  the  new  object 
is  closer  to  tne  viewer,  the  intensity  for  that  object  replaces  the 
old  intensity  at  the  pixel. 

Illumination  can  be  a  bit  difficult  because  surface  normals  cannot  be 
determined  at  every  pixel.  In  a  forested  area  most  pixels  are 
contained  in  trees,  bushes,  grass,  etc.  Since  these  are  being  placed 
on  the  underlying  surface  from  photographs,  there  is  no  control  over 
tne  ooject  surfaces.  An  option  is  to  normalize  the  intensity 
aistnoution  of  each  photograph  as  it  is  prepared  for  entry  in  the 
oata  base.  The  stored  intensities  then  represent  the  ambient 
intensity,  just  as  was  done  for  mapping.  Then,  during  scene 
construction,  the  intensity  can  be  modified  according  to  the  scene 
content;  for  example,  forest  wcula  be  darker  than  fields.  Also,  in  a 
forest  bright  olotches  can  oe  introduced  to  simulate  the  sun  spots 
which  sneak  through  small  openings  in  natural  forest  canopies. 
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uorrect  perspective  can  ce  acmeveo  oy  using  pnotographs  from 
different  aspects  ut  tne  same  ouject.  During  scene  construction,  the 
appropriate  aspect  co  use  can  oe  oeterminea  by  knowing  the  angle  at 
wmcn  the  une-of-signt  intersects  tne  object  (uepression  angle)  plus 
tne  oistance  from  viewer  to  oDject.  If  a  tree  is  assumed  to  be 
reasonaoly  symmetrical,  especially  when  viewea  from  a  oistance,  there 
is  no  need  to  know  the  viewing  angle  aroun a  it. 

To  correctly  represent  an  object  as  it  is  approacnea  requires  a 
sequence  of  pnotograpns,  each  with  greater  levels  of  detail.  To  get 
continuity  in  tne  Display  image,  a  methoo  used  by  cartoonists  can  be 
auoptea.  They  produce  key  frames  (every  fourth  frame  is  an  original), 
then  .intervening  frames  are  interpolatea.  The  resampling  methoa  coula 
be  usea  to  compute  an  image  from  the  nearest  availaule  photograph.  A 
resampiea  image  from  that  farther  photograph  can  also  be  proaucea. 

The  displayed  image  woula  tnen  be  the  average  of  the  two.  This  shoula 
smooth  the  transition  that  woula  otherwise  be  obvious.  Other 
variations  with  translucence  ana  image  interpolation  are  unaer  current 
consideration. 

Note  that  if  the  level-of-aetail  transition  can  be  aone  with 
acceptable  realism,  the  fiaelity  of  the  representation  is  as  good  as 
the  film  usea  to  take  the  picture;  ano  the  object  aoes  not  require  a 
lot  of  computing  time  to  construct  it.  However,  the  level  of  hardware 
integration  is  increased  because  viaeo  equipment  must  interface  with 
aigitai  equipment. 

3. 1.4. 2  Object  Synthesis — Models  can  be  used  to  construct  images  of 
objects.  The  fiaelity  of  the  representation  will,  of  course,  aepena 
on  the  quality  of  the  maael  ana  the  cost  of  using  it.  Some  very  gooa 
moaeis  of  trees  have  been  constructea  by  Marshall,  Wilson,  ana  Carlson 
(1380)  but  it  takes  several  hours  to  produce  one  picture  of  one  tree. 
Newell  (1375)  usea  polygons  in  procedure  models  to  buila  objects  ana 
correctly  portray  them.  Clark  (1976)  recommenas  object  model 
generation  by  structuring  to  simplify  the  sorting  proDlem. 

Although  some  object  moaeis  may  neea  too  much  time  to  proauce 
aynamicaily,  moaeis  can  be  used  to  make  pictures  off-line.  A  aata 
base  can  be  built  of  vioeo  images  which  can  be  resampled  for  display 
in  a  scene. 

An  object  generator  may  have  access  to  other  object  generators  in  the 
fashion  recommenced  by  Clark  (1976).  A  town  generator  may  make 
requests  from  a  road  generator  and  a  house  generator  ana  a  tree 
generator.  Any  of  these  may  use  object  images  from  image  aata  base, 
or  they  may  use  any  of  the  previously  oefineo  texturing  methoas  for 
constructing  objects.  The  following  paragraphs  describe  how  a 
generator  for  trees  might  be  built. 


A  .^rye  proportion  of  natural  terrain  can  oe  realistically  mooeieo  by 
two-dimensional  texturea  surfaces  curing  nign-altituae  flignt.  This 
rs  true  for  forests  ana  for  inaiviauai  trees.  Tne  forests  can  oe 
approximatea  Dy  tne  "mottleo"  surface  of  their  collective  tree  tops, 
anu  inaiviauai  trees  can  be  either  ignorea  or  treatea  as  ranoom  spots 
on  tne  earth's  surface.  However,  ouring  low-altituae  flignts, 
inuivxouai  trees  require  specific  mooeis  for  realistic  simulation. 

once  one  tree  is  constructea,  this  construction  can  be  repeateo  to 
create  a  fieia  of  trees.  8y  aaaing  small  variations  at  each 
repetition  or  oy  using  a  variety  of  trees  (maple,  oak,  etc),  realism 
can  oe  ennanceo.  The  major  problem  is  how  to  create  a  single 
reaxastic  tree  at  low  cost  (high  speea).  Since  only  the  outside  of  a 
xeary  tree  is  seen  at  a  aistance,  the  appearance  of  a  given  tree  can 
oe  simulatea  by  constructing  a  surface;  there  is  no  need  to  be 
concernea  aoout  the  interior  of  the  tree  or  its  actual  structure. 

Tnere  are  potentially  several  ways  to  model  this  surface,  though  it  is 
not  known  whicn  methoa  is  quickest  or  most  realistic.  First,  the 
basic  shape  of  a  tree  coula  be  approximated  with  an  ellipsoio  of 
revolution,  sphere,  or  cone  and  then  the  surface  normals  coula  be 
perturoea  to  create  a  texturea  appearance.  Alternately,  (with  more 
computation),  the  surface  itself  coula  be  perturbea.  This  would  be 
more  realistic  because  the  tree  silhouette  would  be  irregular  rather 
than  smooth.  In  fact,  this  might  be  especially  important  for  the 
recognition  of  evergreens  in  the  winter  since  their  aark  green 
silhouette  against  wnite  snow  is  more  visually  aominant  than  the 
contrasts  among  branches  on  the  tree  interior. 

To  perturb  a  surface,  or  its  normal,  LUTs  might  be  used,  or  some  sort 
of  Harkov  process,  or  perhaps  fractals.  A  choice  could  also  be  maae 
Detween  using  real-worla  data  or  synthesizing  our  own.  A 
aetermination  of  the  best  technique  woula  require  some  experimentation. 

Rather  than  perturb  a  surface  or  its  normal,  a  textured  surface  could 
be  mappeo  onto  the  ellipsoio,  sphere,  or  whatever.  This  would  be 
quick  in  comparison  to  perturbation  but  again  silhouettes  would  be 
smooth.  Tne  tree's  appearance  woula  not  change  correctly  as  the 
ouserver  movea  with  respect  to  the  tree.  (The  surface  itself  woula  be 
perspectively  correct  as  the  viewer  movea  arouna  it  but  the  shaaing  of 
the  surface  woula  oe  incorrect.)  Since  the  tree  surface  woulo  oe 
smooth,  spurious  highlights  woula  appear.  It  might  therefore  be 
necessary  to  simply  assign  a  set  of  intensity  values  to  the  tree. 

A  particularly  simple  moael  would  use  three  flat  surfaces  which 
mutually  intersect,  like  two  ellipsoias  and  one  circle.  This  coula  be 
texturea  in  a  variety  of  ways  but  the  important  idea  is  to  have  the 
aisplay  algorithm  ignore  the  internal  edges  and  display  only  the 
silhouette.  At  certain  viewing  angles,  parts  of  the  planes  might 
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appear  eoge-on.  if  tne  aispiay  algorithm  ooes  not  pick  up  this  kino 
of  nigh-frequency  feature,  it  may  not  oe  a  problem.  Suppose  that  the 
planes  were  "noisy  ellipses"  insteac  of  smootn  ellipses.  This  woulo 
oe  easy  to  generate  ana  much  more  realistic. 

The  easiest  way  to  texture  this  mooel  would  be  to  assign  a 
two-oimensional  texture  to  tne  tree  in  image  space.  For  example,  the 
algorithm  might  be  as  follows: 

1.  Construct  three-plane  tree  in  object  space. 

2.  Transform  to  image  space,  out  araw  silhouette  only. 

3.  Texture  insioe  of  silhouette  accoraing  to  same  statistical 
generator. 

Note  that  this  statistical  pattern  would  remain  the  same  regaroless  of 
viewing  angle  or  aistance.  For  trees  at  a  good  distance,  this  might 
oe  a  gooa  approach. 

Other  texturing  proceaures  might  incluae  mapping  a  texture  onto  each 
piane  or  mapping  a  texture  in  image  space  whicn  was  aepenaent  upon  the 
tree  orientation.  In  the  former  case  realism  would  be  sacrificea 
because,  regaroless  of  how  irregular  the  texture  was,  it  woulo  look 
oao  when  a  plane  was  viewed  at  a  slight  angle.  The  latter  case  is 
more  interesting:  Suppose  that  at  step  3  it  is  known  what  direction 
the  tree  was  facing  with  respect  to  the  view  (that  is,  a  viewer  vector 
ana  a  tree  vector  are  known),  /Tan qIT.  Knowleoge  of  the  relative 
orientation  of  A"ana  iTCor  perhaps  just  their  dot  proouct)  would  allow 
mapping  of  an  orientation-dependent  texture  onto  the  tree  interior. 

In  this  case,  the  tree's  appearance  would  not  change  as  0  changed  or 
as  r  changed  but  would  as  <t>  changed.  The  best  texture  parameter 
woulo  alter  the  texture  such  that  each  incremental  change  in  $ 
changed  the  tree  texture  realistically. 

Benefits — Texturing  techniques  like  mapping  are  useful  when  the 
scene  is  viewea  from  a  distance.  At  short  range  the  need  for 
aiscernabie  inaiviaual  objects  increases.  Mapping  can  be  usea  but 
there  are  problems  with  perspective.  Synthesized  objects  can  be  maoe 
to  represent  the  amount  of  detail  neeaed  for  effective  training.  An 
object  generator  can  be  constructed  for  every  feature  in  the  DMA 
feature  list.  Others  can  be  aaaea  at  will.  The  cost  will  of  course 
uepena  on  the  amount  of  detail  oesireo.  For  example,  if  trees  can  be 
aoequately  representeq  by  triangles  resting  on  rectangular  trunks,  the 
generator  will  be  relatively  cheap.  If  a  lot  of  detail  is  needeo,  as 
in  che  method  of  Marshall,  Wilson,  and  Carlson  (1980),  the  cost  will 
no  aouot  be  high.  The  concept  of  synthesizing  objects  and 
representing  textures  as  aggregates  of  objects  is  needed  where  high 
f ioelity  is  required  for  effective  training.  Perhaps  nap-of-the-earth 
flying  or  low-levei  bombing  will  have  such  requirements.  The  cost  may 
tnen  be  justified. 


Drawcacks — Object  synthesis  is  in  its  infancy.  No  one  knows  wnat 
fidelity  is  neeaeo  for  cost-effective  training.  As  ooject  synthesis 
matures,  the  methods  should  be  simpler  and  experiments  will  be 
conGuctec  to  aetermine  the  contribution  to  training  effect.  At  this 
time  it  is  difficult  to  justify  sophisticated  object  synthesis 
models.  Simple  moaels  such  as  fractaled  ellipses  for  trees,  polygons 
for  houses  and  bridges,  and  cylinders  for  oil  tanks  seem  to  be  the 
proper  level  of  use  of  this  technique.  All  the  DMA  features  can  be 
represented  by  such  models  if  object  images  prove  inadequate  but  the 
cost  in  aollars  ano  time  may  be  excessive. 

3. 2. A. 3  Curved  Objects — In  general,  vector  parametric  bicubic 
equations  are  sufficient  to  generate  a  large  class  of  objects  with 
curved  surfaces.  The  theory  for  these  representations  and  examples  of 
many  objects  generated  from  the  representations  are  available  in  Blinn 
(1576);  Catmull  (1974);  Newman  and  Sproull  (1979);  and  Rogers  and 
Adams  (1976).  A  bicubic  subdivision  process  is  applied  to  these 
objects  just  as  to  terrain  surface  patches. 

3. 2. 4. 4  Operations—Under  ordinary  flight  circumstances,  the 
relatively  small  number  of  objects  in  an  FOV  will  probably  not  add 
more  than  10%  to  the  number  of  surfaces  requiring  perspective 
transformations  and  subdivision. 

3.2.5  Shadows 

The  realistic  generation  of  shadows  is  an  important  factor  in  the 
simulation  of  terrain  contours  and  cultural  objects.  Shadows  are 
especially  important  as  indicators  of  cultural  object  elevations 
besides  providing  clues  as  to  their  three-dimensional  structure.  The 
algorithm  outline  below  describes  the  Honeywell  approach  to  shadow 
generation,  which  has  its  origins  in  the  algorithm  of  Williams 
(1978).  However,  the  algorithm  for  generating  terrain  shadows  is  a 
Honeywell  innovation. 

I.  There  are  several  desirable  or  necessary  features  in  a  shadow 

algorithm: 

1.  Use  a  Honeywell-Catmull  type  subdivision  algorithm, 
rather  than  a  scan-line  algorithm,  because  of  texturing 
and  other  advantages. 

2.  Include  shadows  projected  from  objects  lying  outside  the 
FOV. 

3.  Small  objects  such  as  houses  and  trees  should  cast 
relatively  sharp  shadows. 

4.  Far  objects  (clouds  and  distant  mountains)  should  cast 
shadows  which  are  fuzzy  close  up  but  sharp  at  a  distance. 

5.  When  near  surfaces  shade  distant  surfaces,  the  distant 
shadows  should  be  fairly  sharp  but  should  not  be 
calculated  using  all  of  the  foreground  detail. 
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o.  Off-line  calculations  shoula  ce  incorporated  to  save  time. 

7.  The  shadow  algorithm  shoula  be  simple,  Quick,  ana  snouia 
possess  the  potential  for  future  improvements  concerning 
unique  shaaow  types. 

II.  Several  factors  should  be  avoiaea  or  minimized: 

1.  Long  searches  or  sorts  for  sun-space  hidden  surfaces 

2.  Off-line  calculations  which  determine  snaaows  down  to 
patch  resolution,  creating  olccky  snadows 

3.  Shaaows  cast  by  curvea  surfaces  that  are  incorrectly 
calculated  when  rectangles  are  drawn  about  patch  vertexes 

A.  Some  surface  patches  which  resemble  bow  ties  and  create 
ambiguities 

5.  Sharp  shadow  borders  which  create  more  aliasing  problems 

In  this  algorithm,  five  distinct  types  of  shaaows  are  considered; 
each  type  is  treated  differently. 

o  Type  1  shadows — shadows  cast  by  stationary  cultural  objects 
(trees,  houses,  cars,  etc).  These  shadows  can  be  calculated 
off-line  and  stored  as  additional  cultural  features. 

o  Type  2  shadows — those  occurring  on  stationary  cultural 

surfaces  facing  away  from  the  sun.  Sun-space  surface  normal 
calculations  (off-line)  will  determine  these  surfaces. 

o  Type  3  shadows — these  are  also  called  silhouette  or 

terminator  shadows.  They  occur  only  on  patches  containing 
sun  space  silhouettes;  that  is,  only  on  patches  in  which  one 
or  more  patch  corner  surface  normals  face  the  sun  while  the 
others  face  away,  or  a  patch  which  is  partially  hidden  from 
the  sun  by  some  other  patch. 

o  Type  4  shadows — shadows  that  fall  on  those  patches  totally 
hidden  from  the  sun  by  other  patches.  These  shadows  can  also 
be  tagged  off-line. 

o  Type  5  shadows — those  shadows  cast  by  moving  objects  and 
computed  during  real  time. 

3.2. 5.1  Algorithm  Outline — Shadows  may  be  generated  for  terrain, 
static,  and  moving  cultural  objects,  either  independently  or  in 
parallel.  The  shadows  can  be  cast  by  the  sun  or  moon  from  any  sky 
position  which  is  taken  to  be  stationary  throughout  the  mission 
simulation.  The  generation  of  terrain  and  static  object  shadows  is 
accomplished  partly  off-line  and  partly  on-line,  whereas  moving  object 
shaaows  are  generated  entirely  on-line. 
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ubL description — 

urr-uine  Preparation  of  Terrain  Snaoow  i_apeis — Tne  first  step 
rr,  simulating  terrain  snaaows  is  to  give  each  of  the  aiscrete 
DNiA  mssion  area  eievations  a  snaoow  iaDel,  Gesignating 
lougnly  wnetner  each  eievation  terrain  point  is  or  is  not  in 
snaoow.  This  is  equivalent  to  aetermining  wnicn  points  are 
niooen  from  the  sun/moon  Dy  some  part  of  the  terrain.  This 
proceoure  is  illustratea  in  Figure  26  anu  aiscussea  beiow. 

To  avoia  error,  it  is  necessary  to  obtain  the  DMA  elevations 
appropriate  to  tne  mission  from  one  unifieo  oat a  base.  Tnis 
is  because  DMA  files  are  arrangeo  in  1°  x  1°  square,  ano 
a  mountain  in  one  square  mignt  cast  a  snaoow  upon  terrain  in 
an  aajacent  square.  Calculating  shacows  a  square  at  a  time 
(rather  tnan  for  the  whole  mission  data  base)  woulo  leave 
unshaaeo  regions  along  square  borders,  and  tnis  is 
unacceptable. 

It  is  assumea  that  the  sun/moon  is  located  at  infinity  so 
that  the  shaaows  are  cast  by  parallel  rays.  To  aetermine 
whether  an  elevation  point  is  hiaaen  benino  some  terrain  from 
the  point  of  view  of  the  sun,  we  employ  a  two-pass  affine 
transformation  (affine  because  the  illumination  rays  are 
parallel) . 

In  the  first  pass,  four  adjacent  elevations  representing  the 
four  corners  of  a  patch  are  transformed  at  a  time;  this  is 
oone  for  all  mission  patches.  Once  these  points  arrive  in 
"sun  space,"  the  sun  space  pixels  covered  by  the  patch  are 
oeterminea,  ana  each  covered  pixel  is  assignea  a  depth 
(oistance)  equal  to  the  average  of  the  depths  of  the  four 
patch  corners.  In  addition,  if  a  patch  corner  lies  in  one  of 
the  coverea  pixels,  the  pixel  is  re-assigned  the  oepth  value 
of  the  corner  point. 

The  affine  transformation  is  simply  that  given  by  the  matrix 
transformation  from  world  to  eye  coorainates,  Described  in 
subsection  3.1.3  of  this  report.  Pixel  size  in  sun  space 
would  ioeaj-iy  oe  much  smaller  than  the  maximum  projecteo 
aimensions  of  a  typical  patch,  but  storage  constraints  limit 
the  pixels  to  those  just  small  enough  not  to  introduce 
Distracting  errors.  Based  on  our  experience  in  generating 
pictures  with  Catmull-like  algorithms,  it  is  assumea  that 
four  pixels  per  polygon  (on  the  average)  are  requirea 
although  future  specific  tests  of  the  most  appropriate 
sun-space  pixel  size  are  advised. 
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Figure  28.  Off-line  preparation  of  terrain  shaaow  labels. 
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-uter  aii  affine  transformation,  paten  dimensions  wij.x  ce  mere 
or  less  equai  over  one  entire  sun-space  "screen,"  allowing  a 
uniform  pixel  size  tnrougnout.  (Note:  there  is  no  pnysicai 
sun-space  screen — it  is  oniy  a  matnematicai  aostraction. ; 
noweve*,  all  vertical  pixel  dimensions  will  oe  scalea 
according  to  the  altitude  of  the  sun/moon,  in  proportion  to 
tne  cosine  of  tne  altitude;  that  is,  in  proportion  to  tne 
vertical  dimensions  of  tne  patch  projections  oh  tne  sun-space 
screen.  This  ensures  proper  resolution  oy  scaling  pixels  so 
tnat  tne  ratio  of  their  vertical  to  Horizontal  dimensions 
approximately  equals  tne  ratio  of  paten  Dimensions  in  sun 
space. 

To  aetermine  whicn  pixel  centers  are  CGvereo,  eitner  of  two 
tests  can  0e  empioyeo :  the  first  approximates  the  patch 
projection  with  a  rectangle  enclosing  tne  four  vertexes.  It 
is  fast  (22  aaas  per  paten)  but  slightly  inaccurate.  The 
alternative  approximates  the  patch  projection  with  a  polygon 
constructed  From  tne  paten  vertexes.  It  is  much  slower  (92 
aGas,  24  multiplies,  8  aiviaes  per  patch)  ana  more  accurate. 

A  singular  defect  of  this  alternative  is  that  it  occasionally 
misses  so-called  bow  tie  polygons  (see  Figure  26).  Because 
of  this  potential  error,  ano  because  the  rectangle 
approximation  is  probably  sufficient,  the  simpler  ana  faster 
rectangle  test  is  preferable.  To  accommouate  those  who  might 
wish  to  test  these  alternatives  in  tne  future,  a  brief  theory 
ana  computational  estimate  for  both  tests  are  proviaeo  in 
Figure  29. 

After  the  sun-space  pixels  have  been  assignee  aeptn  values,  a 
second-pass  affine  transformation  of  vertexes  .elevation 
points)  is  made,  exactly  like  the  first.  If  a  vertex  fails 
within  a  pixel  having  a  lesser  depth  value,  tne  vertex  is  in 
snadow;  otherwise,  the  vertex  is  not  in  sna aow.  It  is 
convenient  to  transform  four  vertexes  at  a  time  so  that  the 
surface  patch  as  a  whole  can  be  assignee  a  shaoow  lapel.  If 
aii  four  vertexes  are  in  shadow,  the  patch  is  given  a  shaoow 
label,  if  none  of  the  four  are  in  snaaow,  no  laDel  is 
assigned.  If  one,  two,  or  three  vertexes  are  in  shaoow,  the 
patch  is  given  a  special  "shaoow  boroer"  designation  ano  the 
specific  shaded  vertexes  are  also  aesignatea.  Finally,  eacn 
vertex  that  oelongs  to  a  shadow  boraer  patch  is  assignea  a 
ranaom  integer  "x,"  where  1  2.  x  L  io.  It  is  essential  that 
a  vertex  shared  by  adjacent  patches  have  the  same  integer 
regardless  of  the  patch  that  it  belongs  to.  Figure  30 
contains  an  estimate  for  the  number  of  off-line  operations 
performed  in  the  preparation  of  shaoow  labels. 
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Rectangle  Test  Procedure 

1.  Given  four  vertexes  in  sun  space,  determine  maximum  and 
minimum  x  and  y  values  (x,  y  are  sun  space  screen 
coordinates). 

2.  Assign  z-values  to  pixel  cpnters  inside  the  rectangle. 


Total  Operations:  —  22 

Total  Time:  22  x  0.38  Msec  x  5  x  10®  patches  =  42  sec 


Polygon  Test  Procedure: 

1.  Given  four  vertexes,  compute  equation  for  each  edge. 

2.  Using  a  clockwise  (or  counterclockwise)  ordering  rule,  assign 
inequality  rule  denoting  inside  and  outside  to  each  edge 
equation. 

3.  Determine  rectangular  enclosure  (as  given  above). 

4.  Select  all  pixel  centers  within  the  rectangle  for  testing 
by  four  inequalities  and  test. 

5.  Assign  z-values  to  pixel  centers  within  polygon. 

Total  Operations:  92  adds,  24  multiplies,  8  divides 

Total  Time:  92  x  0.38  Msec  +  24  x  12.7  Msec  +  8  x  14.6  Msec  x  5  x  10 
—  42  min 


Figure  29.  Rectangle  anG  polygon  tests. 


There  are  several  operations  involved  in  obtaining  shadow  labels.  By  far  the  most  time-consuming 
are  the  two  affine  transformations  of  the  mission  data  base  points.  The  remaining  operations 
are  insignificant  in  comparison,  and  can  be  ignored. 

One  affine  transformation  consists  of  a  (4  x  4)  matrix  multiplied  by  a  4  vector.  It  requires 
at  most  16  multiplies  and  9  adds. 

16  *  11.2  ms  =  0.17  msec 
+  9  *  0.38  ms  =  negligible 
+  I/O  avg.  =  1.0  msec 

1.19  msec  per  transformation 

There  are  two  passes  of  the  transformations.  Each  point  is  redundantly  transformed  four 
times,  and  there  are  5x10°  data  points. 

Total  time  =  1.19  x  10®  x  2  x  4  x  5  x  10®  =  13.2  hrs 

Note  that  special-purpose  hardware  used  for  the  perspective  transformation  during 
realtime  could  be  used  for  the  affine  shadow  transformations  off-line,  thereby 
reducing  the  time  considerably. 


Figure  30.  Off-line  shaoow  label  operations. 
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2.  Real-Time  Generation  of  Terrain  Shadows — During  the  mission 
simulation,  patches  that  have  no  shadow  label  will  be  left 
alone,  ana  will  be  illuminatea  according  to  the  method 
explainea  in  suDsection  3.2.1.  Those  patches  with  a  shadow 
label  are  entirely  shaaea;  that  is,  the  intensity  of  the 
entire  patch  is  made  ambient  appropriate  to  the  constraints 
of  weather  and  training  effectiveness.  In  other  words,  the 
intensity  is  arbitrary  and  can  be  set  at  will. 

The  only  patches  requiring  significant  computation  during 
real  time  are  "shaaow  border"  patches.  These  patches  undergo 
fractal  subdivision  in  the  same  way  as  is  done  for  terrain 
texture.  Unaer  the  best  conditions  (overcast  sky  or  sun  at 
SO0  altitude)  there  will  be  no  shadow  border  patches, 
however,  when  the  sun  (or  moon)  is  low  in  the  sky,  the  number 
of  100-meter  square  areas  (patches)  containing  shadow  borders 
may  amount  to  a  significant  fraction  of  the  total  number  of 
patches  in  the  mission  aata  base.  For  typical  terrain,  it  is 
assumed  that  this  fraction  never  exceeds  1/100,  and  is 
usually  on  the  order  of  1/500. 

Shadow  border  patches  are  of  three  types : 

1 .  One  vertex  in  shaaow 

2.  Two  vertexes  in  shadow 

3.  Three  vertexes  in  shadow 

As  with  texture  border  patches,  a  "false"  elevation  of  "1"  is 
assigned  to  each  vertex  in  the  light  and  a  "0"  is  assigned  to 
each  vertex  in  shadow  off-line.  Using  the  random  numbers 
assigned  off-line,  and  a  single  shadow  fractal  look-up  table, 
a  rough  false  surface  is  manufactured  during  the  subdivision 
process.  When  the  average  false  elevation  of  a  subpatch  is 
greater  than  one-half,  that  subpatch  is  assigned  its  ordinary 
reflectivity.  When  it  is  less  than  one-half,  the  subpatch 
reflectivity  is  decreased  so  as  to  shade  it.  Based  on  the 
operations  estimate  on  texture,  the  operations  necessary  for 
terrain  shadowing  are: 

Typical  Case:  1/500  number  of  patches;  fractal 
subdivision  in  parallel  with  all  other  subdivision 
processes  (see  Figure  19). 

Worst  Case:  1/100  number  of  patches;  fractal 
subdivision  in  parallel  with  all  other  subdivision 
processes  (see  Figure  19). 

It  is  important  to  understand  that  the  off-line  and  real-time 
terrain  shadow  generation  techniques  are  entirely  independent 
of  the  other  AVSS  algorithms,  and  can  be  eliminated  or 
included  at  will.  Also,  some  future  experimentation  must  be 
conducted  to  create  the  most  suitable  fractal  LUT  for  shadow 
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ooraers.  It  may  even  prove  profitable  to  investigate  the 
application  of  specific  shadow  LUTs  for  each  terrain  texture 
type,  rather  than  just  one. 

3.2. 5.2  Static  Cultural  Object  Shaaows — Cultural  objects  will  be 
represented  either  as  video  images  or  "as  collections  of  polygonal  and 
curvea  surfaces.  Viaeo  image  shadows  can  be  obtained  as  additional 
viaeo  images.  Thus  a  tree  shaaow  would  be  stored  as  a  video  image 
along  with  its  tree  image.  The  shaaow  image  distance  would  be 
assigned  a  priority  bit  so  that,  when  placed  at  some  surface  location, 
the  surface  would  not  occlude  the  shadow. 

Static  cultural  object  shadows  involving  CIG  surfaces  are  of  two 
types:  those  occurring  on  cultural  surfaces  facing  away  from  the  sun 
and  those  occurring  on  surfaces  cast  by  the  cultural  objects.  For 
polygonal  objects,  an  on-line  dot  product  test  of  surface  normals  with 
the  sun  vector  will  determine  whether  a  surface  is  or  is  not  facing 
the  sun.  If  not,  such  a  surface  may  be  assigned  only  an  ambient 
intensity,  and  zero  reflectivities,  as  are  all  surfaces  in  shadow. 

Case  shadows  are  assumed  to  fall  on  flat  surfaces.  This  makes 
calculations  much  easier  and  is  sufficiently  accurate  since  locally 
the  curved  terrain  surfaces  are  flat.  Because  the  sun  is  in  a 
constant  position  during  the  mission,  all  such  cast  shadows  can  be 
calculated  off-line  and  stared.  The  easiest  method  to  produce  cast 
shadows  is  to  project  the  object  a  polygon  at  a  time  onto  the  flat 
surface.  Each  projection  of  a  polygon  is  then  a  shadow  polygon 
itself.  The  collection  of  all  shadow  polygons  from  a  single  cultural 
object  is  the  shadow  of  the  cultural  object. 

During  real-time  image  generation,  these  shadow  polygons  can  be  called 
up  for  display,  and  just  as  with  ordinary  polygons,  they  can  be 
assigned  positions  in  object  space.  Shadow  polygons  will  also  receive 
priority  bits,  so  that  when  their  Ze  and  the  surface  Ze  are  very 
close,  the  shadow  Ze  will  be  assigned  to  the  pixel. 

Depending  on  the  polygonal  cultural  object,  some  of  its  surfaces 
should  not  have  projected  shadows  calculated.  For  instance,  a 
flat-topped  warehouse  will  produce  shadows  from  only  two  of  its  side 
surfaces. 

The  display  of  polygons  representing  either  cultural  object  or  shadow 
surfaces  is  analogous  to  the  display  of  terrain  patch  surfaces  in  that 
both  are  subdivided  until  they  are  pixel-size  elements,  at  which  point 
enclosing  rectangles  determines  pixel  coverage.  However,  cultural 
object  polygons  can  be  linearly  subdivided  in  screen  space  very 
quickly;  this  is  the  method  suggested  for  their  display.  Note  that 
determining  the  pixel  covered  by  cultural  object  polygons  is  not 
efficient  if  the  enclosure  test  uses  the  polygon  edges  themselves  (see 
Figure  29).  This  is  especially  true  of  the  typically  small  polygons 
which  compose  a  house  or  car,  etc. 
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Lurveu  oujeccs  will  project  curveo  snacows.  These  shacows  are  to  ce 
uetineo  orf-nne  for  a  given  sun/moon  position  for  each  curveo 
object,  it  is  suggestea  that  only  simple  curveo  forms  be  useo 
spntres,  cyimoers.  cones)  because  their  affine  projections  onto  flat 
surfaces  involve  only  straight  line  segments  ano  ellipse  segments. 
Thus,  knowing  tne  equation  of  the  curveo  objects,  the  equation  of 
their  projections  may  be  aetermineo  by  projective  geometry.  From 
these  equations,  control  points  may  oe  formea  ana  thus  cuDic  curves 
may  ue  useo  to  oefine  the  shadow  bounGary  (see  Rogers  ano  Aoams 
(1*76;;  Chapters  A  ana  5  proviae  aetaiis). 

Moving  objects  snoula  be  moaelea  as  collections  of  polygonal  surfaces 
since  curveo  surfaces  make  real-time  shaaow  generation  Difficult.  As 
with  static  cultural  objects,  moving-object  snaaows  will  be  generatea 
oy  an  affine  projection  to  a  flat  surface,  one  object  polygon  at  a 
time  but  in  real  time.  Assuming  only  one  or  two  moving  objects  in  an 
FGV,  eacn  composed  of  only  a  few  aozen  polygons,  less  than  a  hunGrea 
affine  transformations  woula  be  requirea  per  frame  time.  The  haraware 
for  tnis  transformation  wouio  De  available  because  it  is  iaentical  to 
part  of  the  perspective  transformation  haraware  (the  matrix 
multiply;.  Consequently,  cost  ana  computation  are  minimal. 

Aovantaqes — It  should  be  notea  that  terrain  shaaow  generation  is 
inexpensive  because  it  employs  the  same  bicubic  methods  off-line  as 
are  usea  for  terrain  patches.  It  also  contributes  to  a  unifiea  scheme 
for  the  simulation  of  the  real  worio  ana  represents  only  a  minor 
increase  in  complexity.  Lastly,  the  vast  majority  of  calculations  are 
maoe  off-line,  reserving  only  the  most  necessary  terminator 
calculations  for  real-time  calculation. 

Disaovantaqes — Because  of  the  bicubic  surface  ana  the  large 
cnanges  in  slope,  the  terminator  may  appear  wavy  regardless  of  how 
fuzzy  it  is.  If  this  is  the  case,  some  special  pre-processing  may  be 
necessary.  For  example,  the  shaaow  elevation(s)  coula  be  averagea 
with  their  neighbors. 

3.2.6  Special  Capabilities/Considerations 
3.2.6. 1  Lights — 

Point  Light  Sources — Point  light  sources  must  appear  as  small  as 
possible  but  also  muse  not  display  aliasing  artifacts.  This  object 
can  be  met  by  treating  each  point  light  source  as  an  approximately 
pixel-size  object  with  a  Gaussian  intensity  Distribution.  Since  the 
point  source  is  oefinea  to  appear  the  same  from  all  angles,  the 
Gaussian  Distribution  is  inaepenaent  of  orientation  ana  is  a  function 
of  aistance  only.  Figure  31  illustrates  a  typical  point  light  source 
represencea  uy  three  concentric  boxes  (pyramid)  approximating  a 
Gaussian  Distribution,  superimposed  on  a  grid  of  pixels.  Note  that 
the  pyrnmia  shifts  transiationaily  across  the  screen  as  the  point 
source  moves,  but  never  rotates. 
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Figure  31.  Point  light  source  pyramio:  approximation 
to  gaussran  oistrioution. 
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Trie  dxaci  pyramid  dimensions  must  ue  specified  after  some  perceptual 
testa,  tu  minimize  artifacts.  The  pyramid  intensity  aecreases  as  one 
uvei  Liie  spuaie  of  tne  uistance  (x/u .  The  intensity  can  oe 
equated  to  tne  integral  of  tne  Gaussian.  This  integral  is 
proportional  to  any  or  tne  box  heignts.  For  example,  at  one  Distance, 
tne  concentric  oox  neignts  might  oe  (5,  2,  1).  At  some  closer 
uistance  tney  wouio  oe  aajustea  to,  say,  (iQ,  A,  2).  Thus,  the 
heights  are  ail  aojustec  proportionally. 


Tne  distance  useo  for  tne  intensity  computation  is  precisely 


♦  Yg  ♦  Z^J1/2 


Again,  however,  perceptual  tests  may  inaicate  that  this  factor  can  be 
approximated  with  a  less  costiy  function,  inoeea,  it  is  possible  that 
tne  xntensity  function  may  be  upaatea  every  few  frame  times  without  a 
noticeaoie  fucker.  Tne  aistance  factor  also  appears  in  subsection 
3. 2. o.4.  It  is  approximated  there  by  Zg,  so  the  same  convention  is 
useu  nere. 

Uccultation  of  point  sources  is  best  hanolea  by  treating  just  tne 
occultation  of  the  point  itself,  not  the  pixel-size  object 
representing  it.  This  reduces  z-buffer  compares  ana  perspective 
transformations  as  well  as  more  realistically  proviaing  an  immediate 
unset  or  offset  of  the  point  source. 

Extenoeo  Light  Sources—Extenoeo  light  sources  are  of  two  types: 
directional  ana  nan-airectional.  Non-oirectional  (that  is,  isotropic) 
light  sources  are  easily  moaelea  by  associating  a  constant  intensity 
with  the  surface  wmch  serves  as  the  light  source  structure. 
Directional  light  sources,  like  searcnlights,  can  be  modeieo  by  a 
surface  whose  intensity  aepends  on  the  oot  proauct  of  its  surface 
normal  vector  with  tne  viewer  vector  in  object  space. 

Rotational  ana  Flashing  Capabilities — Rotating  a  airectional  light 
source  is  simply  a  matter  of  making  tne  surface  normal  of  the  light 
source  rotate;  that  is,  programming  the  vector  normal  position  as  a 
function  of  time.  Similarly,  the  rotation  of  an  object  (such  as  a 
searchlight  beam)  can  oe  pre-programmeo.  A  flashing  light  will  have 
its  intensity  programmea  as  a  function  of  time. 

3. 2.6. 2  Translucence — There  are  three  categories  of 
computer-generateo  translucence  effects: 

1.  Atmospheric  effects — includes  rain,  snow,  haze,  fog,  etc. 

2.  Translucent  objects — incluoes  clouos,  plumes  from 
smokestacks,  oust  raised  by  vehicle  movement  or  explosions, 
anG  smoke. 
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3.  "Fade-in  objects" —  Grainary  cultural  objects  that  are 
oesignea  to  face  grauuaxiy  into  the  scene  oy  appearing 
initially  as  pixel  size  anc  nigniy  translucent,  with  the 
transiucence  lessening  as  the  objects  move  Closer  to  the 
viewer.  This  special  form  or  anti-aliasing  heips  avoia  tne 
aistraction  of  objects  which  sucoeniy  appear  on  the  screen 
when  tney  reach  pixel  aimensions.  The  alternative  is  to 
present  cultural  oDjects  at  a  subpixel  level,  wnich  is 
simpler  but  not  as  cepenaaole  because  suopixei-size  objects 
will  not  be  accurately  anti-aiiasea,  pernaps  ieaoing  to  a 
"jumpy"  appearance.  Since  an  ODject  is  oistracting  only  when 
it  pops  on  tne  screen  with  a  high  contiast  relative  to  the 
oackgrouno,  the  special  application  of  transiucence  snoulo  be 
of  primary  concern  in  tne  moaeling  of  extenoeo  light  sources 
at  night. 

in  tnis  case,  the  oark  background  makes  tne  treatment  especially 
simple.  When  greater  tnan  pixel  size,  an  extenaec  source  can  be 
assigned  a  constant  intensity,  ano  when  less  than  pixel  size,  it  can 
oe  treated  as  a  point  source,  decreasing  intensity  as  1/r^,  or  more 
cneapiy,  i/Z|. 

The  Basics — Given  a  scene  which  contains  an  object  partially 
ouscurea  by  some  meaium,  the  following  relation  holas: 

s(tsh)  +  t(B0)  =  B 

where 

B  =  brightness  of  the  obscured  object 

B(-,  =  brightness  of  the  obscuring  medium 

60  =  brightness  of  the  object  without  an  obscurant 

x  =  transmittance  of  light  (how  much  light  passes  through 
the  medium  as  a  fraction  of  1) 

S  =  saturation  =  1  -  t,  amount  of  absorbeu  or  scattered 
light 

This  is  caileo  the  transiucence  relation. 

For  example,  given  a  ought  ubject  with  B0  =  i5Q  ano  a  oark  cloud 
(.Bn  =  zQ)  that  transmits  30  percent  of  the  light  inciaent  upon  it, 
tne  apparent  brigntness  of  the  object  will  be: 

U  -  0.3)z0  +  (0.3)130  =  39 

for  an  object  at  aistance  r,  x  =  e_ar,  where  a  is  callea  the 
"extinction  coefficient"  and  represents  the  fraction  of  light  lost 
when  passing  through  some  medium  of  thicKness  r. 

The  apparent  b.  '.ghtness  of  an  object  viewea  through  the  atmosphere  or 
any  other  obscuring  meaium  is  (after  substitution): 
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where 


,  -or  _  , ,  -^r  . 

□  =  3  e  +5,  (1-e  ) 

o  h 

3  =  apparent  brightness  of  the  object  viewed  through  a 

scattering  meaium 

B0  =  object  brightness  viewed  at  zero  distance  (or 
equivalently,  with  no  scattering  medium) 

B)-,  =  sky  brightness 

a  =  fraction  of  incident  light  scattered  per  unit  volume 
of  medium 

r  =  distance  from  viewer  to  object 


Tms  relation  is  the  cure  of  ail  transiucence  effects  since  it  holas 
for  an  wavelengths  ano  materials.  In  tne  eno,  tnerefore,  oniy  60, 
6h,  ano  x,  or  equivalently,  B0,  bh,  a  ano  r,  are  neecec. 


Derivation  of  transiucence:  When  light  is  incioent  upon  some  small 
volume  of  a  medium,  part  of  the  light  is  scattereo  equally  in  all 
directions,  part  passes  througn  the  meaium. 


The  incicent  intensity  is  aecreaseo  in  proportion  to  its  magnitude, 
tnat  is,  a  light  twice  as  intense  will  loose  twice  as  much  to 
scattering: 


wneie  ax  is  the  thickness  of  the  meaium,  a  is  given  above,  ano  the 
minus  sigr  is  present  oecause  the  intensity  is  decreasing. 

The  solution  to  tms  equation  is 


Now  consiaer  viewing  a  black  object  through  the  atmosphere  (see  Figure 
32).  The  brightness  of  the  black  object  can  be  founa  by  first 
aetermining  how  much  light  is  scattered  from  the  cone  volume  into  the 
eye. 

A  un±t  volume  will  scatter  l0a;  therefore,  the  light  scattereo  in 
ail  directions  by  the  volume  element  aax  will  be  I0oaax.  This 
win  oe  aecreaseo  oy  e_crx  as  it  goes  through  the  meaium.  The 
solid  angie  of  tne  viewing  cone  is  a/x^  fsteraaians) . 

Since  there  are  Att  steraaians  for  an  entire  sphere, 

a/xf  _  light  scattered  into  the  eye 

U7T  —  T  -ax 

I  a  aaxe 
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cwlx=  VOLUME  ELEMENT  OF  AIR  (SCATTERING  MEDIUM) 
a=  AREA  OF  VOLUME  ELEMENT  SEEN  BY  VIEWER 


Figure  32. 


Viewing  a  black  object. 


Thus,  the  light  scattered  into  the  eye  from  the  volume  element 

=  I  aa2dxe‘ax 
o 

- 2 - 

4ttx 

Since  brightness  is  proportional  to  the  light  reaching  the  eye  per 
surface  area  of  the  object,  the  brightness  of  the  volume  element  will 
be  proportional  to: 


1 

a 


IQa  a2dxe-ax 


4ux 


aae~axdx 

2~  = 
4ttx^ 


Aae-axdx 


where  A  =  constant,  since  a/x^  =  solid  angle  is  a  constant.  Therefore, 

the  total  brightness  of  the  air  from  the  cone  in  front  of  the  black  object  is: 


£  rAae-axdx  =  A(1  -  e-ar) 
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Tnc  sky  origntness,  Dn,  can  ue  obtained  by  placing  tne  black  object 
at  infinity : 


3h  “  b  Acre”JXax  =  A 

-vicn  d.  =  A,  the  brigntness  of  the  air  in  front  of  the  black  ooject  is 


onu  -  e_ar) 


For  an  arDitrary  non-oiack  ooject  of  brightness  B0  at  zero  Distance, 
ics  origntness  at  aiscance  r  equals: 

6  =  B0e~ar  +  Bh(l  -  e"ar) 

Translucent  Dejects — The  categories  are: 

o  Atmospheric  clouas,  all  types  tnat  oo  not  cover  the  entire 
sky  ana  are  structurally  autonomous 

o  Plumes  of  smoke  or  water  vapor  from  factories  or  burning 
objects 

o  Dust  raised  by  moving  vehicles  ana  explosions 
o  Exhaust  from  air  vehicles 

o  Smoke  or  spray  from  artillery  or  smoke  pot  generation. 

Exothermic,  non-exothermic,  instantaneous  burn,  finite  burn, 
point  source,  linear  array  (of  smoke  pots  or  spray). 

To  moael  these  objects  usually  requires  a  rough  ioea  of  the  ooject 
oimensions  as  a  function  of  time  0(t),  the  brightness  of  the  oDject 
Bp,  (for  example,  white  smoke  or  black  smoke),  and  the  transmittance 
t,  in  some  cases,  as  a  function  of  time.  In  other  woros,  it  will  be 
uesirabie  to  take  into  account  the  depenaency  of  t  on  the  extinction 
coefficient  a  ana  the  optical  depth  of  the  object  (r).  However, 
some  objects  may  be  aoequately  treateo  by  assuming  a  constant  x. 

The  algorithm  for  translucent  object  simulation  assumes  a  base 
structure  on  whicn  a  fiactaleo  surface  is  generated.  The  base 
structure  can  be  altered  in  time  to  grow,  elongate,  or  stretch  in  an 
aroitrary  oirection  to  simulate  the  expansion  or  diffusion  of  a  clouo 
of  oust  Qi  smoke. 

The  oase  structures  can  be  stored  or  generated  in  a  separate  data  base 
and  each  structure  oisplayea  independently.  To  simplify  optical  oepth 
calculations  for  multiple  surfaces,  a  clouo  or  puff  of  smoke  can  be 
moaelea  inwara  froman  enclosing  oase  structure  (see  Figure  33). 
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c  Atmospneric  Ciouos — Modifications  of  fractal  tecnniques 

sncuj.0  oe  pcv,errui  enougn  to  model  many  cioug  types.  Beycno 
tne  simple  oase  structure  cecnniaue,  some  ciouos  can  oe 
moueieu  in  tne  same  way  tnat  Fournier  moaeieG  is±ancs ; 
intersecting  a  piane  surface  witn  a  fractaiec  surface,  fly 
using  non-Gaussian  oistrioutions,  absolute  values  of 
Qistributions,  ana  distortions  in  transformations,  we  will  oe 
aDie  to  surpass  the  confines  of  pure  fractal  simulations. 

o  Plumes  of  Smoke  or  Water  Vapor — Plumes  from  factories  vary 
enormously  oe  nGing  on  literally  dozens  of  factors.  An 
accurate  modeling  is  achievaDle  witn  pernaps  a  month's 
effort.  A  cruoe  modeling  tnat  can  oe  done  aimoct  immediately 
simpiy  employs  a  oase  structure  resemoling  a  curveo  truncateG 
cone,  which  is  fractaiea  to  appear  puffy. 

Translucence  woula  be  moaelea  as  a  function  of  the  distance 
aiong  the  parametrically -defined  plume.  Thus,  the  clouo 
woula  aisappear  gradually. 

For  IR  views,  a  plume  is  often  very  bright  at  the  smokestack, 
dimming  at  successively  larger  distances.  For  this  effect, 
intensity  can  be  changed  as  a  function  of  distance. 

o  Dust,  Exhaust,  Smoke— Military  ana  weapons  effects  are 

discussed  in  subsection  3. 2. 6. 6;  more  details  on  smoke  ana 
water  vapor  translucence  properties  are  contained  in 
subsection  3. 2. 6. 4. 


LINE  OF  >IGHT  THROUGH 
A  CLOUD  INTERSECTS 
SEVERAL  SURFACES. 


LINE  OF  SIGHT  THROUGH  AN  ENCLOSING 
BASE  STRUCTURE  ALONE  INTERSECTS 
ONLY  TWO  SURFACES.  NOTE:  THE  BASE 
STRUCTURE  IS  NOT  DISPLAYED;  IT  IS 
ONLY  USED  FOR  AN  OPTICAL  DEPTH 
CALCULATION  FOR  VISIBLE  PARTS  OF 
THE  CLOUD. 


Figure  3->.  Wooeiing  ciouos  for  optical  depth. 
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Movinu  i'iOGcis — 1'ioviny  oojecLa  are  of  two  types  :  those  h i t r 
-rf-iine,  prsceterminec  .'notion  ana  tnose  with  free  interactive  metier,. 

Preocterminec  Aircrart  potion — A  tnree-cimensrcnai  aircraft  parr 
Can  oe  cescricec  uy  a  time-oepenoent  position  vector: 

Pv.tJ  =  P<.x(t)  ,ylt),zu;j 

where  x,y ,  z  are  the  worla  cooroinates  ana  t  =  time  =  parameter,  anc  cy 
an  aircraft  orientation  vector: 

Gvxu),yU),zUJ) 

A  precise  knowxecge  of  0  aepenas  on  an  explicit  mathematical 
unaerstanaing  of  aircraft  attituoe  for  aroitrary  paths,  velocities, 
ana  accelerations,  not  to  mention  expectea  piiot  maneuvers.  Because 
of  tne  complications  innerent  in  specifying  IT  anc  7^  for  complex  paths, 
preceterminea  aircraft  motion  snouio  De  appiiec  oniy  to  tne  simplest 
of  patns,  such  as  circles  ana  straight  lines.  In  this  way,  IT ana 
can  Pe  storeo  as  simple  vector  parametric  functions,  ratner  than  as  a 
iaiye  collection  of  precomputec  points,  ana  tne  functions  can  be 
easily  evaiuatea  in  real  time. 

in  air-to-air  combat  scenarios,  it  is  suggesteo  that  the  enemy 
aircraft  oe  representea  symoclically .  Because  of  tne  relative  speeos 
mvoiveo,  it  is  unnecessary  to  try  to  represent  a  small  object  with 
curveu  oi  flat  surfaces.  The  orientation  of  flight  surfaces  can  pe 
representea  by  straignt,  narrow  lines  whose  contrast  with  tne 
oackgrouno  is  a  function  of  weather  ana  perceptual  conoitions. 

Preceterminea  Grouno  Vehicle  Motion — Grouna  vehicle  motion  is 
quite  Different  from  aircraft  motion  oecause  "F^  ana  0  must  obey  the 
constraints  of  the  terrain  contours.  Rather  than  specifying  xU), 
yUi,  ztt;  for  the  path,  it  is  easier  to  specify  xit)  ana  y(t)  ana 
sucstitate  the  x  ana  y  values  into  the  bicubic  surface  equation  to 
Determine  z(t).  Then  (x,  y,  z)  can  be  storec  off-iine  for  each  frame 
position  ana  callea  up  curing  real  time. 

An  aroitrary  curvea  path  over  arbitrarily  curveG  bicubic  terrain 
patenes  can  be  constructea  off-line  as  follows: 

1.  Oraw  t by  nano)  a  rough  curve  over  an  (x,y)  terrain  map  to 
inaicate  the  venicle  path  ana  starting  ana  enaing  points; 
provioe  the  venicle  speeo. 

2.  Determine  the  intersection  cooroinates  of  the  path  curve  with 
tne  (x , y )  gna  lines.  These  latituae-iongituae  gria  lines 
correspona  to  the  bicubic  patch  eages. 

3.  Substitute  each  coorainate  pair  into  the  corresponaing 
uicubic  surface  equations  to  aetermine  the  intersection 
elevations  (z) . 
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Tne  curve  cc,nts*ncc  in  eac.n  pater,  nas  enepoints  at  p  =  C  anc 
P  =  x. 

It  as  assumed  tr <it  tr,c  v— mere  move  at  a  constant 

velocity  j  t ii a t  ^s,  it  ,iix-  move  equa.1.  arc— iengcns  escr  f late 
time*  Off—iine,  tne  total  arc— ier.gtn  of  eacn  paten  curve 
win  ce  determined  cy  numencaixy  integrating  tne  fuix0.ving 
expressren: 


wrtn  tne  velocrty,  Determine  tne  distance  (is;  moved  in 
1/00  second.  Then  determine  s/As  =  numoer  of  As 
intervals  in  s. 

Eventually,  (x,  y,  z)  will  oe  neei jq  at  arc-lengths  of  0, 
As,  2As,  3As,  4As...s,  giving  the  venicie  position 
each  frame  time: 


t  =  0 

i/30 

2/30 

3/30 

3  =  0 

As 

iAs 

3AS 

Tnis  gives  x t p ; ,  ytp),  z(p);  but  x(s),  y(s),  zisj  are  neeGec. 

However,  the  analytic  relation  between  tnese  expressions  is 
difficult.  Therefore,  numeric  methoos  will  be  employea. 

Numeric  methoa: 

a.  Sample  the  parameter  p  at  0,  i/2G,  2/20,  3/2G, ...  19/20, 

1.  (.The  number  20  is  arbitrary!. 

o.  Using  the  arc-length  integral  equation  20  times,  fine 
tne  arc  length  for  each  p-vaiueo  segment: 

1/20  i/20  1 

svp  =  0,  p  =  i/iu,  etc?  =  /  ,  /  ,.... 

0  1/20  19/2G 

c.  Fit  a  curve  to  these  points  ano  then  sample  the  curve  jt 
equal  As  intervals,  where  the  number  of  samples  per 
patch  =  s/As. 
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u.  Going  oackwaras,  eacn  As  will  correspona  to  some  p  value, 

wnich  in  turn  can  be  suostituteo  into  x(p),  y(p).  This  gives 
tne  vehicle  (x,y)  position  as  a  function  of  time  (or 
equivalently,  arc  iength).  For  eacn  (x,y)  pair,  substitute 
into  the  bicuoic  patch  equation  to  fina  (x,y,zj.  These 
values  shoula  be  storea  off-line  as  points. 

Notes : 

o  With  a  60-Hz  refresh  rate,  the  same  position  is  usea  for  two 
consecutive  frames.  A  one-minute  simulation  woulo  require 
storing  60  x  30  =  1800  positions  but  a  longer  simulation  is 
easily  obtamea  by  closing  the  preaetermineo  vehicle  path  ana 
looping  back  through  the  aata. 

o  To  avoia  having  As  intervals  overlap  patch  corGers,  the 
nearest  integer  to  s/As  can  be  usea,  giving  only  a  slight 
velocity  Discontinuity  at  boraers,  for  example,  (AO  mps — ► 
40.06  mphj. 

o  The  greatest  amount  of  off-line  expense  is  incurreo  by  having 
to  oetermine  the  path.  Ostensibly,  the  computation  of  20 
integrals  per  patch  seems  time-consuming,  but  in  step  5,  the 
integral  from  zero  to  one  can  be  composed  of  20  rectangular 
sections,  so  that  each  of  the  integrals  in  8b  can  be  taken 
lmmeoiately  as  those  rectangles;  for  example, 


1/20 

/  f (p)dp  =  f (1/20)  x  1/20 
0 

Vehicle  Orientation — Vehicle  orientation  can  be  specifiea  by  two 
vectors:  a  surface  normal  vector  (n5  and  a  vector  tangent  to  the 
vehicle  path  (v£).  Rather  than  take  derivatives,  these  vectors  can 
ue  approximated  with  no  loss  in  realism. 

yw  zul)  -?(«!■  yr  zt) 

AS 

N  =  Vt  x  W 

where  W  =  vector  tangent  to  the  surface  and  mdre  or  less  perpenoicular 
zoTt. 


The  oase-point  coordinates  o_f_W  and  Vt  are  equal.  Without  proof, 
the  enapoint  coordinates  of  w  =  (x,y,z),  where  specifically: 

x  =  -V25m2Am2  +  1)  _  yi+l  '  yi 

m  =  - 

, - - -  ^  '  Xi 

y  =  y25/(  m2  +  1)  +  y^^ 
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Tne  value  of  z  can  oe  founa  uy  suostituting  into  the  bicubic  equation 
fox  tne  surface  patch.  <Jhe  factor  of  15  is  aruitrary  ana  aetermines 
tne  length  of  IT,  wnicn  snoula  oe  short  enough  to  be  an  accurate 
representation  of  a  tangent  ratner  tnan  a  secant  but  not  so  short  that 
computer  errors  preoominate. ) 

To  summarize,  for  a  vehicle  moving  over  a  given  patch,  position  ana 
orientation  information  will  be  calculateo  off-line  ana  storea,  for 
preaetermineo  motion. 

interactive  Vehicle  Motion — Interactive  aircraft  motion  consists 
of  position  ana  orientation  being  upoatea  each  frame  time  uy  an 
interactive  control  mechanism  ana  operator.  This  information  is  fea 
tu  tne  screen  space  of  the  trainee  ana  processea  just  as  any  other 
surface  information:  with  intensity  computea,  z-buffer,  ana 
anti-aliasing  appliea. 

in  tne  reai  worla,  the  orientation  of  another  aircraft  may  be  sightea 
at  a  great  aistance  because  tne  human  eye  is  especially  sensitive  to 
iinear  features.  In  these  cases,  the  simulation  of  such  resolution  is 
not  ootainaole  by  simply  averaging  the  aircraft  intensity  over  a 
pixel.  There  are  two  potential  solutions. 

The  first,  ana  simplest,  is  to  moael  the  aistant  aircraft  with  a 
several-pixel  length  "stick  moael"  whose  flight  surfaces  show  an 
obvious  orientation.  For  high-speea  combat,  this  may  well  be 
auequate.  We  believe  this  model  shoula  be  attemptea  first.  The 
secona  solution  involves  a  high-resolution  projection  system  which 
woula  have  to  be  specially  designed  and  aoded  to  the  flight 
simulator.  This  would  incur  consiaerably  more  expense  and  should  be 
consiaered  only  as  a  last  resort. 

Interactive  grouna  vehicle  motion  is  constrained  to  the  grouno 
surface.  The  interactive  control  mechanism  provioes  (x,y)  position 
information  airectly  each  frame  time  or  inairectly  through  velocity 
ana  oirection  information.  Given  the  (x,y)  position,  the  z  value  can 
oe  aeterminea  by  substituting  into  the  bicubic  equation  of  the  surface 
patch  containing  (,x,y).  To  know  which  patch  the  vehicle  is  on,  a 
search  must  be  maae  through  some  predeterminea  list  of  patches,  which 
is  not  too  large.  It  follows  that  knowleage  of  the  possible  patches 
across  wmch  a  vehicle  will  pass  must  be  proviaea  off-line  before  the 
mission  is  run,  ana  that  tne  bicubic  equations  must  be  known  for  each 
of  tnese  patches.  The  latter  information  can  be  obtained  as  soon  as 
tne  bicubic  coefficients  for  the  patches  are  determined  off-line  (the 
bicubic  equations  are  completely  determined  by  the  bicubic 
coefficients).  It  so  happens  that,  with  a  bit  of  manipulation,  the 
coefficients  can  be  obtaineo  from  the  register  squares,  so  that  a 
grouna  vehicle  area  may  oe  determinea  after  the  mission  data  base  is 
formea,  this  is  just  a  less  efficient  proceoure. 
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Venicle  orientation  is  aojustea  each  frame  time  by  the  methoc 
ucscrioeo  in  the  previous  subsection  on  preoetermineo  grouna  vehicle 
onentat-.on.  This  requires  an  aoaitional  substitution  into  tne 
bicubic  equation.  Thus  for  each  frame  time,  two  substitutions  must  be 
maoe.  These  operations  constitute  the  majority  of  computation  for  a 
venicie  traversing  arbitrary  terrain.  The  few  aozen  multiplies 
involveo  are  trivial  in  comparison  to  the  other  system  computation 
rates. 

when  fractal  perturbations  are  aoaed  to  terrain  surfaces,  they  will  be 
smaii  enough  to  not  aiffer  from  the  bicubic  elevations  significantly 
where  vehicle  motion  occurs.  Thus,  for  example,  a  tank  will  not 
appear  naif-burieo  in  the  terrain,  or  floating  above  it.  If  some 
particular  textural  effect  is  a  high  priority  ana  can  be  obtainea  only 
by  using  large  fractal  oeviations,  a  special  processor  can  be 
implementea  to  aisplay  intensities  accoraing  to  the  perturoeo  surface 
normals  while  using  unperturbea  elevations  for  the  surface  aisplay. 
This  is  analogous  to  Blinn's  (1977)  methoa.  This  alternative  is 
available  but  is  not  soliciteo  for  implementation  because  of  the 
aoditional  cost  ana  complexity. 

3. 2. 6. 4  Atmospheric  Effects — Atmospheric  visibility  is  mooelea  in 
accoraance  with  the  translucence  relation: 


B  =  Boe‘or  +  Bh(l  -  e-0*  ) 

where 

Bf,  =  sky  brightness 

B0  =  object  brightness  with  a  clear  sky 

B  =  total  brightness 

r  =  distance  between  observer  and  object 

a  =  "extinction  coefficient";  represents  the  fraction  of 
light  lost 

The  sky  brightness,  B,  is  calculated  as  follows.  Bh  and  a  are 
determined  off-line  with  o  depending  on  the  weather.  B0  and  r  are 
determined  each  frame  time  for  each  pixel  corresponding  to  the  terrain 
ana  cultural  object  data  base.  B  is  then  found  for  each  pixel  each 
frame  time.  Some  calculations  may  be  avoided  by  employing  an  LUT 
containing  t  =  e_or  for  various  r  and  constant  o,  which  is 
constructed  off-line  and  is  weather-oepenaent .  The  table  would 
contain  256  values  of  x  in  equal  increments,  ensuring  a  continuous 
range  of  orightness. 
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Tnus,  the  procedure  is  co  obtain  a  for  a  given  mission  ana  construct 
tne  LUT  off-line.  Then,  auring  real  time,  consult  the  table  for  each 
polygon  Distance  {ij,  fino  t,  ana  piug  into  tne  translucence 
equation  to  fine  the  final  object  brightness. 

a,  or  equivalently  x  for  various  r,  is  available  (Duncan,  1580) 
for  conaitions  of  haze  unaer  all  humidities,  sea  ana  land  fogs,  light, 
meaium,  ano  heavy  rain,  ana  snow  for  the  following  banawiGths: 

Visual  =  0.4  to  0.7  pm 

DLL TV  =  0.8  to  1.1  pm 

FL1R  =  8  to  14  pm;  (3  to  5  pm  sometimes) 

For  aaoitional  realism,  the  sky  itself  can  be  moaelea  as  hazy  along 
che  horizon  with  vioeo  techniques.  For  example,  a  simple  sky 
pnotograph  would  be  used  as  a  background  for  all  computer-generated 
imagery.  It  would  only  have  to  be  rotated  ana  translatea  in  real  time 
to  accommodate  ail  perspective  scenarios.  Note  that  this  technique  is 
especially  realistic  ana  can  even  handle  night  skies  with  the  stars 
appearing  in  their  proper  locations. 

Altituae-depenoent  visibility  effects  can  be  modeled  to  any  of  four 
levels  of  oetail.  The  first  and  crudest  simply  ignores  such  effects 
ana  assunes  a  homogeneous  isotropic  atmosphere.  The  fourth  level 
incorporates  both  isotropy  and  homogeneity  effects,  ano  the  second  and 
third  levels  incorporate  one  of  the  two  effects. 

consider,  for  example,  that  mountain  peaks  generally  appear  clearer 
than  mountain  oases.  This  can  be  simulated  by  substituting  a 
fictional  observer-object  distance  (rf)  into  the  translucence 
equation,  where 

rf  =  r  -  g(Z*) 

gU*)  =  some  function  of  the  object  elevation;  depends  on 
sensor  and  weather 

The  above  is  a  particular  isotropy  mooel. 

Now,  consider  that  an  observer  on  the  grouno  would  use  a  different 
rf  than  an  observer  at  some  arbitrary  altitude.  Thus,  a  more 
realistic  (ana  expensive)  view  would  result  in 

rf  =  r  -  g(zwo,  z#p) 

where 

Zy,0  =  object  elevation 
=  pilot  elevation 
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uxouus— Tne  merits  of  two  types  of  ciouo  mooels  will  be 
uiscusseGT  However,  no  one  methoG  is  inoicatec  as  best  because  future 
rests  are  requireo  to  accurately  Getermine  their  technical 
feasibility,  cost,  ana  perceptual  qualities. 

1.  As  an  extension  of  terrain  texturing,  fractals  suggest 
themselves  for  clouos.  For  example,  a  puffy  appearance  may 
be  generated  by  using  absolute  values  in  a  fractal  LUT.  This 
can  be  superimposea  as  a  perturbation  on  ellipsoids  to 
generate  cumulus  ciouas,  or  upon  a  flat  surface  to  generate 
an  entire  bank  of  clouos. 

Alternately,  imagine  creating  a  fractal  surface  on  a  flat 
surface  of  large  extent,  if  the  perturoations  are  arrangeo 
correctly,  some  will  be  above  the  flat  base  surface,  some 
ueiow.  by  cutting  out  those  below  ana  assigning  a  uniform 
wmte  to  tnose  areas  above,  a  partly-clouay  sky  surface  can 
be  manuf acturea .  This  is  potentially  realistic  anG  it  would 
employ  the  same  haraware  used  for  terrain  fractals. 
Unfortunately,  it  wouia  be  time-consuming  because  of  the  mass 
of  additional  perspective  transformations  incurred.  This 
could  be  reduced  by  taKing  advantage  of  the  coherence  of  the 
flat,  clouoy  sky  surface  ano  subdividing  in  image  space; 
however,  special  image  space  haraware  would  then  be  required. 

2.  Video  methods  show  some  promise  in  making  both  individual 
ciouas  ana  cloudy  sky  surfaces.  The  former  can  be  treateo  by 
taking  static  photos  of  the  ciouas  required  for  any  weather 
scenario  and  placing  them  in  the  mission  data  base.  The 
perceptual  approximation  of  keeping  the  same  cloud  face 
towara  a  pilot  flying  by  may  be  sufficiently  real  to  employ. 
(A  viaeo  tape  of  trees  passing  by  with  the  same  face  always 
to  the  viewer  has  been  examinee  and  appears  to  be 
acceptable).  With  this  approximation,  only  screen 
translations,  rotations,  ana  magnifications  would  be  needed. 

With  a  clouoy  sky  surface,  an  additional  operation  of 
!  "perspective  magnification"  would  be  neeaeo.  This  is  where 
closer  parts  are  magnifiea  more  than  distant  parts;  it  is 
equivalent  to  a  perspective  transformation.  An  algorithm  for 
this  process  is  oiscusseo  in  Catmull  and  Smith  (1980).  This 
algorithm  would  probably  require  special  real-time  hardware. 
Tne  great  aovantage  of  viaeo  clouds  is  their  realism,  their 
applicability  to  all  ciouo  types,  ano  the  ease  with  wnich 
they  may  be  made  translucent,  since  they  are  simply  a  video 
overlay  of  terrain  or  sky  imagery. 

3. 2. 6. 5  Sun/Moon — Modeling  the  sun  itself  is  accomplisheo  by  creating 
a  uniformly  bright  circle  ana  placing  it  at  a  constant  orientation 
with  respect  to  the  world.  Similarly,  the  moon  and  various  phases  of 
it  can  be  createo  and  appropriately  placea. 


During  the  days  of  iow  irraaiance  (overcast  skies),  the  illumination 
is  partly  isotropic  ana  partly  airect  (Stenger,  Dungan,  ano  ReynolGs, 
iyl'y;  Steven  ano  Unsworth,  1975)  ana  can  be  approximately  moaelea  by 
adjusting  the  amoient  intensity.  The  moon's  illumination  of  the 
cioualess  earth  at  night  is  insignificant  unless  the  moon  is  gibbous 
or  larger.  In  such  cases,  terrain  surfaces  can  be  moaelea  dimly  in  a 
manner  analogous  to  the  sun  illumination  scheme.  The  only  difference 
is  that  ail  surfaces  will  be  maae  colorless  since  low  light  level 
human  sight  is  insensitive  to  color.  Color  effects  on  terrain  at 
sunset  are  relatively  easy  to  aaa,  simply  shift  the  relative  amounts 
of  hue  towara  the  rea. 

3.2. 6. 6  Weapon  Effects — Explosive  effects,  flashes  of  colored  light, 
etc,  can  De  mooeled  as  a  succession  of  objects  with  each  object 
lasting  one  frame  time  and  the  entire  explosion  lasting  no  more  than 
1/10  secona.  Each  surface  of  the  object  would  be  assigned  a  specific 
intensity  ana  would  be  independent  of  the  usual  object-intensity 
calculation.  Therefore,  each  explosion  woula  be  perspectively  correct 
ana  connected  to  a  specific  point  on  a  surface  element.  It  woula  be 
visiole  only  if  no  terrain  or  cultural  surfaces  occluued  it. 

Smoke  ana  dust  clouas,  whether  generated  by  smoke  pots,  grenaaes, 
artillery  bombardment,  or  fire,  can  be  simulateo  by  translucent, 
fractaleG  objects  which  grow  or  elongate  according  to  wino 
conaitions.  Making  the  puffy  smoke  appearance  change  in  time  can  be 
accompiishea  by  using  a  time-aependent  fractal  LUT. 

Object  change  can  perhaps  be  mooeled  by  video  techniques,  as  can 
certain  objects,  but  computer-generated  damagea  cultural  objects  can 
also  oe  manufactured.  Simple  crater  or  bomb  blast  effects  would  be 
among  the  list  of  objects  representing  weapons  damage  where,  depenaing 
on  the  object  or  terrain  struck  by  a  projectile,  a  given  damagea 
object  woula  be  placea  in  the  display.  Again,  the  state  of  the  art  in 
video  imagery  ooes  not  allow  us  to  predict  the  feasibility  or  expense 
of  its  implementation. 

The  great  difficulty  in  simulating  weapon  effects  is  not  that  they  are 
difficult  to  simulate,  but  rather  that  an  overabundance  of  reference 
material  is  available  on  particular  effects  ana  the  time  spent  in 
researching  several  dozen  special  effects  for  a  aetailed  simulation  is 
rather  costly.  See  Zirkind  (1978)  and  Ebersole  ana  Vaglio-Lauvin 
(i>80). 

3.3  IMAGE  QUALITY 

To  this  point  operational  requirements  ana  imagery  characteristics 
have  been  covereo.  The  thiro  part  of  this  section  aeals  with  the 
image  quality  or  the  elimination  of  known  artifacts  which  occur  in 


present  DIG  eage-oasea  systems ,  to  ce  consioereo  are  anti-aliasing 
ana  image  complexity.  In  anti-aliasing,  the  concern  is  with 
quantization  ano  interlace  effects. 

3.^.1  Anti-Aliasing 

An  urainary  raster  image  representation  suffers  from  aliasing  defects 
oecause  it  displays  high-frequency  featuies  via  a  lower-frequency 
point  sampling  technique.  When  objects  move  across  an  image,  further 
oefects  are  introduced,  such  as  the  "jaggies"  anc  the  flickering  of 
small  objects  which  are  sometimes  lost  by  the  sampling  process.  A 
rather  elaoorate  analysis  of  aliasing  effects  may  be  founa  in  Crow 
US77). 

Among  the  variety  of  anti-aliasing  techniques  which  may  be  appiieo  are 
blurring  the  image,  sampling  ana  displaying  at  a  higher  resolution, 

(. convolving  the  image  with  a  sine(x)  function  (or  approximation ) , 
dithering,  ana  area  averaging.  Blurring  the  image  is  cheap  because 
one  can  simply  aefocus  the  display  device,  but  it  is  perceptually 
inaumissiole .  Employing  a  higher-resolution  sampling  frequency  ana 
display  is  very  expensive,  does  not  cure  all  static  aliasing 
artifacts,  and  is  ineffective  in  treating  temporal  flicker  ana 
scintillation  effects  (Leler,  1980;  Crow,  1977).  Convolving  the 
image  is  perceptually  aaequate  but  expensive.  Dithering  techniques 
rely  on  the  temporal  averaging  properties  of  the  human  visual  system 
uy  applying  two  simultaneous  operations: 

1.  The  projected  surface  elements  on  the  viewer's  screen  are 
sampled  at  slightly  different  screen  (x,y)  coordinates  each 
frame  time.  These  differences  never  depart  from  one  set 
screen  position  more  than  a  pixel  wioth. 

2.  The  display  hardware  shifts  each  pixei  on  the  screen  to  the 
sampling  position  usea  in  the  previous  operation  (1,  above) 
each  frame  time. 

If  this  proceoure  is  carriea  out  quickly  enough,  ano  in  an  appropriate 
manner  over  a  pixel-size  area,  an  anti-aliasea  image  will  be  built  up 
because  the  viewer  tenas  to  average  quick,  successive  imagery. 

Current  display  hardware  allows  a  maximum  sampling  frequency  of  60 
Hz.  Suppose  ooject  intensities  were  sampled  at  only  two  different 
screen  locations  ana  dithered  corresponding  to  the  opposite  corners  of 
a  stationary  pixel.  The  intensity  at  the  first  corner  would  be 

determined  at  t  *  0,  the  intensity  at  the  second  corner  at  t  =  1/60, 

bacK  to  the  first  corner  at  t  =  1/30,  etc.  No  flicker  would  be  seen 

oecause  the  images  fuse  when  presented  at  greater  than  about  25  Hz. 

However,  the  sampling  would  be  inadequate  because  only  two  samples  are 
taken.  Aliasing  would  be  reducea  but  not  eliminated. 
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Sampling  at  four  screen  locations  woulc  reduce  aliasing  even  more,  but 
tnen  a  given  sampie  point  wouia  oe  refresneo  every  1/13  sec.  In  cases 
wnere  a  nign-contrast  ODject  covereo  only  one  sample  point,  a 
distinctly  perceivable  flicker  would  be  seen.  Therefore,  regardless 
of  tne  number  or  distribution  of  sample  points,  aithering  is  not  a 
feasiole  option. 

The  anti-aliasing  technique  chosen  here  is  called  area  averaging.  In 
its  most  rigorous  form,  it  is  equivalent  to  the  convolution  of  an 
image  intensity  with  some  window  (.rectangular  or  Barlett  triangular). 
However,  ±z  can  oe  approximated  by  averaging  discrete  sample 
intensities  over  a  pixel-size  area. 

An  aooitional  perceptual  benefit  of  this  technique  is  that  apparent 
resolution  will  be  increased.  This  is  because  below  a  certain  angular 
size,  object  size  ana  brightness  are  interchangeable;  that  is,  they 
are  perceptually  equivalent.  Leler  (1580)  aiscusses  this  in  the 
summary  of  his  paper. 

3.3. 1.1  Anti-Aliasing:  Local  or  Global? — One  of  the  most  intensively 
studied  issues  in  this  study  has  been  whether  to  apply  anti-aliasing 
locally;  that  is,  to  certain  small  areas  on  the  screen,  or  gloDally; 
to  the  entire  screen.  To  apply  local  anti-aliasing  one  must  know 
which  areas  require  it.  In  general,  these  areas  contain  high-contrast 
features  such  as  silhouettes,  texture  boraers,  shadow  borders, 
cultural  oojects,  ano  point  sources. 

cultural  objects,  texture,  and  shadow  borders  can  be  localized  ana 
treated  according  to  Duncan  (1980).  However,  terrain  silhouettes  are 
very  difficult  to  treat,  especially  when  fractal  perturbations  are 
added. 

Now  suppose  those  pixels  requiring  anti-aliasing  were  easy  to  locate, 
if  so,  a  dynamic  memory  allocation  would  be  required.  For  scenes 
containing  many  high-contrast  features  (for  example,  low-level  flight 
over  bumpy  terrain  or  any  flight  over  shaaeo  terrain  when  the  sun  is 
at  a  low  angle,  or  high-altituae  flight  over  diverse  agricultural 
areas)  as  much  as  105b  to  20%  of  the  screen  would  have  to  be 
anti-aliased.  Clearly,  the  cost  of  such  oynamic  allocation  would 
exceea  simpler  static  global  anti-aliasing  requirements. 

Therefore,  because  of  the  worst-case  requirements,  because  there  is  no 
quick,  straightforward  localization  technique  for  silhouettes,  ano 
because  each  high-contrast  feature  would  require  its  own  specialized 
localizing  technique,  global  anti-aliasing  is  preferred.  Neither 
shouia  the  potential  importance  of  global  anti-aliasing  be 
underestimated  for  producing  a  uniform  ana  homogeneous  image  of 
perceptually  high  resolution,  as  proposed  by  Leler  (1980). 
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oiuw  vib6i;  x nves cigar ea  many  different  samplings  for  anti-aliasing. 

A  i  x  o  Dartiett  wmoow  aiiowea  nG  aliasing  artifacts  ano  a  ;>  x  3 
oaitictt  winoow  snoweG  Sxignt  artifacts  with  long,  narrow, 
myn-contrast  specular  features.  Tests  uy  others  at  Honeywell  reveal 
tnat  anasing  preaominates  at  the  along  linear  features  out  is  not 
especially  notable  aiong  irregular  boroeis  or  in  nighly-textureo 
areas.  For  natural  terrain  ana  orainary  cultural  objects  (houses, 
roaos,  etc;,  a  3  x  3  oartiett  winoow  will  suffice.  This  is  oecause 
trie  predominant  long,  narrow,  linear  features  are  roau  surfaces, 
raiircao  tracks,  ano  agricultural  oounaanes,  none  of  wmch  is  of 
especially  high  contrast. 

Tne  winoow  given  by  Crow  is: 

ill 

i  A  2 

1  2  1 

Tnese  are  the  weightings  assignea  to  each  sample  point  intensity.  The 
weightings  are  very  neipfui  in  reducing  aliasing.  Typically,  a 
non-weigntea  rectangular  winoow  is  not  as  effective  in  aliasing 
reuuction  (.Crow,  1981,  Feioush,  Leroy,  ana  Cook,  1980). 

Recall  that  in  tne  aisplay  algorithm,  pixei-size  polygonal  surface 
elements  are  approximatea  oy  rectangles.  In  general,  these  rectangles 
will  have  a  maximum  dimension  equal  to  a  pixel  ano  a  minimum  dimension 
somewnat  less.  The  enclosing  rectangles  are  always  orientea  with 
sioes  parallel  to  the  screen ;  that  is,  they  are  never  rotated.  Thus 
in  tne  case  where  a  polygon  eage  coveres  one  of  the  "2"  weights  in 
urow's  winoow,  the  polygon  will  be  approximatea  by  a  rectangle  which 
coveis  at  least  one  of  the  "1"  weights.  This  reounaancy  can  be 
avoioeo  oy  using  a  winoow  like: 

2  2 
4 

2  2 

wmcn  has  no  siae  weights. 

Since  a  60-Hz  frame  rate  is  assumed,  ana  since  30  Hz  is  greater  than 
tne  fusion  frequency  for  temporally  flickering  lights,  the  above  can 
oe  appliea  oy  sampling  tnree  samples  each  frame  time.  At  t  =  0,  the 
upper  left,  micale,  ana  lower  right  samples  woula  be  taken  ano 
averageo.  At  t  =  1/60,  the  upper  right,  miaale,  ano  lower  left 
samples  woulo  oe  taken  ano  averageo,  ano  so  forth,  switching  aiagonals 
each  frame  time.  This  takes  aavantage  of  the  eye's  temporal  averaging 
ano  consequently  reouces  storage  ano  computation. 
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onia-Li  polygons  can  sometimes  oe  missea  oy  tne  sampling  process  ano  so 
effect  a  scintillation  of  the  polygon  as  it  moves.  This  effect  is  not 
present  in  terrain  surfaces  representea  by  many  small  polygons,  but  is 
xn  speciai  cases  like  cultural  objects  that  are  of  fractional  pixel 
oimensions  ano  of  nigh  contrast.  The  proDiem  can  be  solvea  by  setting 
horizon  limitations  on  such  objects.  For  example,  houses  woulo  not  be 
lntroGuceo  until  pixei  size,  ano  even  then  they  woulo  oe  blenaeo  into 
tne  image  uy  applying  a  Ze-cepenoent  transiucence. 

interlace  is  not  oiscussea  in  oetaii  since  a  non-interlaceo  raster 
scan  has  ceen  as sumac  accoroing  to  the  requirements  of  the  contract 
study  oojectives: 

Summary  Proceoure:  5  point  average/pixel 

3  points/frame 

operations.  (1024)^  x  3/frame  time  ... 

3.3.2  Image  Complexity 

The  Honeywell  AVSS  simulator  is  designea  to  maintain  a  fast  memory  FOV 
within  a  radius  of  24  km,  ana  to  access  disc  memory  to  upaate  the  fast 
memory  eacn  frame  time.  Thus,  the  only  information  available  to  the 
simulator  at  a  given  instant  is  that  information  neeaeo  for  the 
current  FOV  and  the  next  few  frames  of  potential  FOVs.  Because  of  the 
nature  of  tne  subdivision  algorithms  employed,  a  minimum  of 
information  is  storea  in  the  fast  memory  at  a  100-meter  resolution, 
from  which  an  image  containing  arbitrary  oetaii  may  be  calculated  each 
frame  time. 

The  subdivision  anu  testing  methodology  inherently  maintains  the 
correct  amount  of  scene  resolution  under  arbitrary  circumstances. 
Transitions  from  one  level  of  oetaii  to  another  will  not  be 
perceptible  because  a  maximal  pixel  dimension  is  maintained  for  all 
projected  terrain  ano  cultural  surface  elements  (patches  or  polygons) 
and  these  elements  are  anti-aliaseo. 

j.4  DATA  BASE  GENERATION 

Tne  use  of  two  oata  bases  is  proposed.  The  first  is  the  full  detail 
of  the  DMA  U977)  source  oata,  inducing  texture  oata,  terrain  and 
hydrographic  oata,  anc  man-made  features.  This  oata  base  neeos  to  be 
enhanced  ana  reorganized  for  real-time  scene  generation.  The  oata 
base  produced  oy  reorganizing  ano  enhancing  is  the  second  data  base, 
called  the  mission  oata  base.  The  following  paragraphs  describe  the 
procedure  for  enhancing  and  reorganizing  the  DMA  data  base  to  form  the 
mission  oata  base. 
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Inc  Mission  oata  case  is  constructed  from  tne  worio  oata  oase,  as 
snown  ni  Figure  3<*.  Omy  tne  terrain  xiKexy  to  oe  viewed  uurmg  tne 
traxning  mission  is  copiea  to  the  mission  oata  base.  If  tne  training 
scenario  starts  with  the  student  at  a  particular  aitituae  and 
uxstance,  tne  flignt  path  can  oe  aefineo  as  being  anywnere  within  a 
coriiGoi.  Tne  mission  oata  oase  will  tnen  contain  the  terrain  anu 
cultural  oata  neeoec  to  display  scenes  anywhere  within  the  corrioor. 

This  oata  oase  is  automatically  formatteG  in  a  curveo-earth  cooroinate 
System  oecause  tne  world  data  are  stored  in  tne  wonc  Geodetic 
System.  The  mission  data  base  allows  for  modification  of  individual 
features  through  the  procedures  for  texture  synthesis  ano  for 
individual  ooject  representation  curing  scene  construction. 

Part  of  the  procedure  in  constructing  the  mission  data  base  is  the 
DioGuctxon  of  regional  oata  diocks.  A  regional  oata  clock  is  formeo 
from  lb  known  elevations  ana  contains  ail  cultural  features  within  a 
iOO-meter  square.  Tne  four  elevations  ana  the  surrounding  12 
elevations  are  used  to  compute  register  squares.  The  oata  block 
contains  pointers  to  tne  lists  of  objects,  linear  features,  ano 
texture  areas  representing  cultural  data  in  the  block  (snown  in  Figure 
35  J . 


3.4.1  Texture  Region  Representation 

Tne  digital  lana  mass  system  (DLMS)  data  base  has  coordinates  for 
pomes  on  tne  ooroer  of  regions  of  homogeneous  texture;  that  is, 
regions  witn  one  SMC  coae.  The  cooramates  are  in  latituae  ana 
longituoe  offsets  from  a  manuscript  reference  point.  Texture  regions 
can  oe  constructea  from  the  ooundary  coordinates  by  first  converting 
tne  bounaary  representation  to  chain  coce,  then  forming  ana  organizing 
uiocKs  in  a  quad  tree. 

The  DMA  states  that  the  border  definition  is  not  guaranteed  to  close 
if  tne  region  ooroer  extenas  beyona  the  manuscript  eoge.  In  this  case 
closure  will  have  to  be  forced  by  following  the  manuscript  eoge  ana 
creating  the  missing  coordinates. 

Tne  OLMS  cultural  feature  files  contain  cooes  defining  the  type  ana 
aistrioution  of  objects  within  a  region.  Distribution  for  a  region 
can  oe  useo  to  place  objects  in  the  region.  To  simplify  the  process, 
a  minimal  surrounaing  rectangle  can  be  aefinea  around  the  region. 

This  is  a  rectangle  which  touches  tne  extreme  enos  of  the  region. 
Object  allocation  within  tne  rectangle  puts  an  upper  limit  on  the 
number  of  objects  while  simplifying  the  boraer  definition.  As  each 
object  is  assigneo  to  a  latitude  and  longitude  position,  it  can  be 
passea  through  the  quaa  tree  to  see  if  it  belongs  to  a  data  block.  If 
the  quaa  tree  scan  faiis,  the  object  is  in  the  rectangle  out  outsiae 
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PROVIDED  BY  DIGITAL  LANDMASS  SYSTEM 
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Figure  34.  Mission  uata  base  construction-proceciuie. 


REGISTER  SQUARES 


CORNER  ELEMENT 


Figure  35.  Regional  oata  block. 
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tr.e  xegion  oounoary.  when  the  object  aoes  faii  insiae  a  data  block, 
one  oojecc's  cxavation  is  computed  fxom  the  eievation  coefficients. 

Trie  ooject  is  then  aaoea  to  the  clock's  object  list. 

Object  placement  is  accompushea  with  a  mooel  for  each  SMC  cooe.  At 
most  i3  mooeis  are  neeoeo,  one  for  eacn  SMC  cooe.  Each  mooel  would 
nave  access  to  feature  mooeis  corresponoing  to  the  feature 
xuentification  cooes.  The  percentage  of  tree  anQ  roof  coverage  plus 
raatuie-specific  information  can  ce  useo  to  oistrioute  objects  of  the 
appropriate  type  over  the  area.  The  list  of  oojects  proaucea  by  the 
moaei  can  ue  sorteG  in  latitude  ano  longitude  to  speea  up  the 
allocation  to  regional  data  blocks.  Notice  the  objects  are  not  being 
generated  at  tms  time.  Only  the  object  type  ana  position  are 
produced. 

As  a  summary,  the  procedure  for  mission  oata  base  construction  is: 

o  Step  i — Oefine  the  mission  gaming  area. 

o  Step  2 — Identify  the  terrain  and  cultural  data  files  inciuoeo 
in  the  gaming  area. 

o  Step  3 — Provide  a  list  of  the  object  types  and  textures  which 
can  ue  generated. 

o  Step  4 — Produce  texture  region  quad  trees. 

o  Step  5— Compute  bicubic  elevation  surface  coefficients  at 
one-secono  intervals. 

o  Step  6— Merge  results  of  steps  4  ano  5  to  make  regional  oata 
blocks. 

o  Step  7 — Establish  object  positions. 

o  Step  8 — Construct  object  lists  for  data  blocks. 

o  Step  9— Set  pointers  to  unique  features  ana  synthetic 

textures  for  each  data  block.  Select  texturing  method  based 
on  SMC: 

— Mapping 
— Fractals 

— Aggregation  of  individual  objects 

o  Step  10— Define  illumination  conditions  (sun  or  moon 

position,  visible  or  IR,  weather).  Aqq  IR  characteristics  to 
object  descriptors. 

o  Step  il — Produce  static  shadows. 

o  Step  12 — construct  register  squares. 

o  Step  13 — Construct  mission  quad  tree  from  all  regional  data 
blocks. 
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Tne  output  of  tnis  procecure  is  shown  in  Figure  36.  The  mission  aata 
uast  is  one  one  usea  to  proauce  scenes  in  reai  time,  uonceptually  the 
oat a  are  organized  as  tney  appear  in  Figure  37. 

3.4.z  Mission  Data  Base  Enhancement  for  Illumination 

The  mission  aata  base  at  tnis  stage  is  aoequate  for  producing  black 
ana  white  images  for  the  visiDie  spectrum.  To  proauce  coior  images  or 
infrared  images,  we  need  to  aaa  information  to  the  data  base.  The 
foliowing  paragraphs  will  describe  the  procedures  for  making  coior, 
LLLTV,  ana  IR  images.  The  data  Dase  enhancements  required  are  listed 
in  Taoie  x. 

3. 4.1.1  Coior — Use  of  the  HSV  color  space  is  proposed.  This  color 
space  is  representeu  as  a  cylinder.  The  axis  up  the  center  of  the 
cylinder  corresponds  to  intensity  in  black  ana  white.  Black  is  at  the 
oottom  of  tne  cylinder,  white  is  at  the  top.  Hue  is  wnat  the  layman 
calls  color,  such  as  red  or  green.  Hue  is  determined  by  the  angular 
position  around  the  central  axis  of  the  cylinder.  Saturation  is  the 
distance  from  the  central  axis  toward  the  outer  surface.  This  is 
illustrated  in  Figure  38. 


Mission  Data  Base: 

•  Is  the  collection  of  all  regional  data  blocks 
(now  called  patches) 

•  Contains  in  each  rdb 

1.  Register  squares  defining  bicubic  elevation 
surface 

2.  A  pointer  to  list  of  unique  features  which  pass 
through  the  patch 

3.  A  pointer  to:  A  synthetic  texture  definition 

and  a  list  of  objects 

4.  An  intensity  for  display  when  the  patch  projects 
to  one  pixel 

•  Has  patches  representing  variable-size  areas 

•  Is  organized  as  a  quad  tree  to  facilitate  finding  the  patches 
for  a  given  frame  and  controlling  the  level  of  detail  processed 


Figure  36.  Mission  data  base  contents. 
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DATA  BASE 
COVERAGE 


REGIONAL  DATA  BLOCKS  ARE  QUADRILATERALS  FORMED  BY  FOUR  POINTS 
AT  THE  TEXTURE  AND  ELEVATION  RESOLUTION  IN  THE  DATA  BASE 


Figure  >7.  Quad  tree  data  base  organization. 


TAdLc.  x.  uATm  dASE  ENHANCEMENTS  FOR  ILLUMINATION 


PlIR _ 

Surface  material 

—Solar  aosorptivity 
— Grouno/sky  absorptivity 
— Sensor  oand  aosorptivity 
— Surface  cross-section 

Internal  thermal  environment 
far  a  feature 

Sky  thermal  radiance 

Ground  thermal  radiance 

Air  temperature 

wind  vector 

Attenuation  rate 
Precipitation 
Point  spread  function 
Response  curve 


LLLTV 

Sensor  Dane  reflectivity 

Surface  condition 

Internal  lighting  conditions 
for  a  feature 

Point  spread  function 

Response  curve 

Color  for  visual 
Hue 

Saturat  ion 

Shininess  coefficient  for 
specular  component 

All  the  Above 
Sensor  band 
Sun  position 
Sun  direct  radiance 
Sun  diffuse  radiance 


Figure  38.  HSV  color  space. 


109 


une  advantage  or  tne  HiV  space  is  tnat  the  effect  of  atmospheric 
scatter j.ny  can  oe  simuiatea  oy  interpolating  between  the  object's  nue 
ano  a  nonsaturateo  oiue.  This  proouces  the  blue  overtone  seen  on 
objects  viewto  at  a  aistance.  Another  aovantage  is  tnat  interpoiation 
Can  easily  preserve  saturation  between  hues,  whiie  this  is  more 
oifTicuxt  in  ctner  color  spaces. 

A  tnree-Qxmensional  table  is  neeaeo  to  use  HSV.  The  inuexes  to  the 
tabie  are  h,  S,  anu  V.  The  values  in  the  taole  are  the  colors  to  be 
pLoauceo  by  the  color  guns  in  the  Display.  Value  (in  HSV;  is 
Determined  oy  the  illumination  mooei.  Vaiue  is  the  intensity  computed 
oy  tne  illumination  model.  Hie  ano  saturation  are  ooject-oepenaent, 
so  they  must  oe  specif ieo  in  the  aata  base  or  curing  object 
generation.  This  means  eacn  texturing  methoa  ano  object  generators 
must  have  accei-'  to  ano  induce  hue  ana  saturation  parameters. 

3. 4.^.1  Infrareu — The  illumination  moael  for  the  FLIR  sensor  bano  (8 
to  14  um;  is  substantially  Different  from  the  viside  lignt.  To 
compute  the  intensity  on  a  surface,  whether  it  is  natural  terrain  or 
tne  surface  of  a  cultural  Object,  we  need  to  know  the  pattern  that 
corresponos  to  the  temperature  ana  emissivity  of  the  surface.  Even  if 
tne  emissivity  of  the  surface  can  De  assumed  to  be  static,  the 
temperature  is  not.  It  oepenas  on  the’  time  of  the  day,  the  direct 
rauiance  from  the  sun,  the  aiffuse  radiance  from  the  sun,  and  other 
factors. 

Tnermal  modeling  of  the  surfaces  of  cultural  objects,  specifically 
buildings,  nas  been  done  with  the  view  of  computing  the  temperature 
profiles  or  buildings.  The  profiles  include  the  reflection  of  the 
sun,  air,  winospeea,  ano  direction  as  well  as  precipitation 
Uimnerlin,  Suthy,  ana  Stenger,  1S750 .  This  moael  attempts  to  predict 
tne  temperature  of  the  surface  based  on  the  characteristics  of  the 
surface  materials,  which  inciuae  the  solar  absorptivity,  ground/sky 
aosorptivity ,  sensor  band  absorptivity,  surface  cross-section,  ana 
internal  thermal  environment.  These  characteristics  plus  emissivity 
of  the  surface  must  be  aoaea  to  the  mission  aata  base. 

3. 4. 2. 3  LLLTV — The  low  light  level  systems  in  use  today  are  the 
silicon  vioicon  ana  -us  derivations  ano  fiber-optically  coupled 
sxnyle-aioue,  aoubie-oioae,  or  micro-channel  image  intensifier 
systems.  The  simplest  oevice  is  the  silicon  vioicon,  which  has  a 
response  extending  into  the  near-infrared,  especially  when  useo  with 
tungsten  lighting.  An  object  is  seen  against  its  background  because 
tnere  is  a  reflectivity  difference  causing  contrast.  The  wavelength 
uepenaence  of  the  contrast  is  determined  by  the  materials  involved. 
However,  no  one  material  can  be  characterized  by  a  single  reflectivity 
curve,  so  materials  are  usually  characterizes  by  their  average 
reflectivity. 
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in  summary,  Tauie  1  lists  the  enhancements  needed  fdi  generatidn  af 
li_i_TV,  FliR,  ano  cdicr  images,  in  anaitien  te  Zimmerim,  Suthy,  ana 
Stengei  Shana  (1975)  anc  Thomson  U665)  alsa  provide  useful 

inf uimatian. 


3.4.3  Data  Base  Size/Ccntent 


Tne  mission  data  case  is  the  callectidn  ef  all  regicnal  data  blacks 
(.patcnes/.  Each  regicnal  oata  bicck  ccntains: 

o  Register  squares  defining  bicubic  elevaticn  surface 
o  Painters  tc  lists  of  cultural  features 

o  Pointers  to  fractal  look-up  tades  (shadow  borders,  texture 
ooroers,  textures) 

o  A  surface  normal  vector 

o  Pointer  to  textural  shaoow  information 

These  oata  are  organizea  as  a  quao  tree  to  facilitate  finding  the 
patches  for  a  given  frame. 


The  amount  of  oata  present  is  basea  on  a  gaming  area  of  800  km  x  48 
km.  As  an  estimate  there  will  be  5  x  1CP  oata  elevation  points  to 
oe  consiaerea.  Each  elevation  oata  point  has  the  following  bits 
associateo  with  it: 


o  Vector  normal 

o  X,  Y  location 

o  Size 
o  Texture 

o  Shaoow 
o  Data 


48  bits 
32 
16 
8 
8 

256  (16  x  16) 
- 368  bits 


For  ail  patcnes,  the  data  storage  is: 

5  x  10^  *  36b  =  230  Mbytes 

- 5 - 

For  a  safety  factor,  another  mass  storage  unit  can  be  added,  to  give  a 
total  capacity  of  about  512  Mbytes. 


Ill 


SECTION  4 


IMPLEMENTATION  CONSIDERATIONS 


implementation  requirements  for  the  on-line  real-time  processing  are 
oiscusseo  in  this  section,  including  the  fast  FOV  memory,  perspective 
transform,  testing,  subaivision,  intensity  calculation  ana 
occuitation,  anti-aliasing,  ana  the  frame  buffer.  Each  of  these  areas 
requires  a  special  implementation  basea  on  the  amount  of  aata  to  be 
processeu,  how  fast  the  haroware  can  oe  expectea  to  operate,  ana  the 
specific  algorithms  to  be  implemented. 

4.1  HARDWARE  IMPLEMENTATION 

A  previous  discussion  considered  the  ramifications  of  having  a  narrow 
FOV  versus  an  entire  FOV.  The  conclusion  was  that  for  best  results 
the  entire  360°  about  a  particular  position  should  be  stored  so  that 
transport  oelay  aoes  not  cause  a  problem.  For  a  60°  FOV  about  2 
Mbytes  of  static  RAM  are  required,  for  the  full  360°  12  Mbytes  are 
neeaeo.  This  memory  is  organized  as  240,000  by  368  bits,  with  only 
40,000  being  accessea  at  any  one  frame  time. 

The  access  time  for  these  memories  is  about  400  nsecs,  which  is  well 
within  the  aynamic  RAM  capability  of  today's  technology.  The  data  in 
these  RAMs  must  be  organized  such  that  simulator  position  input  is 
easily  convertea  to  tne  RAM  aaaress. 

In  Table  2  the  estimated  number  of  64K  x  1  dynamic  RAMs  is  1500.  The 
function  of  Table  1  will  be  to  estimate  the  complexity  of  the  hardware 
to  be  implemented.  The  next  function  to  be  evaluated  is  the 
perspective  transformation. 

The  perspective  transform  was  shown  previously  in  Figure  2  auring  the 
aiscussion  of  transport  delay.  In  this  function,  the  data  in  worla 
space  must  be  projected  onto  the  screen.  This  involves  a  subtraction, 
matrix  multiply,  addition,  ana  then  division  for  the  X?,  Ye 
values.  In  Table  1  the  number  of  parts  for  this  function  are  again 
estimated.  The  parts  are  commercially-available  transistor-transistor 
logic,  large-scale  integrateo  ITTL  LSI)  chips,  except  for  possibly  the 
Divider.  The  divider  will  probably  be  an  LUT  which  gives  the 
reciprocal  U/xj,  followed  by  a  multiplier. 

The  delay  for  TTL  parts  worst-case  for  one  block  is  assumed  to  be  200 
nsec.  In  the  case  of  the  perspective  transfer,  this  would  apply  to 
the  multiplier.  One  could  also  assume  that  some  of  these  items  would 
oe  implemented  using  emitter-coupled  logic  (ECL)  technology.  For  the 
ECL  approach,  a  25-nsec  oelay  might  be  assumed. 


TAbLE  i 


Trie  effaces  on  computational  performance  can  De  examinee  c,y  iooking  at 
me  tnrougnput  race  for  this  uiock.  Using  a  200-nsec  stage  aelay,  the 
numoer  of  operations  that  can  ce  performeo  is  five  million.  The 
numoer  of  perspective  transforms  is  estimateo  to  be  6.8  x  10°  per 
frame  or  406  x  1G°  per  secona.  If  the  throughput  is  5  MHz  for  the 
oipoiar  case  tnen  siigntiy  over  80  parallel  channels  of  this  haraware 
will  oe  requirea.  On  the  other  nana,  if  the  throughput  is  40  MHz  for 
trie  c.ul  approach  tnen  only  10  parallel  channels  are  requirea. 

The  test  function  shown  in  Figures  3  ana  4  requires  the  same  6.8  x 
lu°  tests,  so  again  the  numoer  of  channels  is  10  for  the  EC L 
approacn  ana  60  for  the  bipolar  approach. 

For  tne  suoaivision  (.Figures  5  through  8),  only  one-fourth  the  number 
of  suoaivisions  is  requirea,  or  1.7  x  106.  In  this  case  the  number 
of  cnannels  woula  be  three  for  the  ECL  case  ana  20  for  the  bipolar 
case.  Note  that  the  perspective  transform  ano  tester  should  logically 
oe  four  times  as  many  as  the  subaivision  for  maximum  throughput  since 
each  subaivision  proauces  four  new  values  at  the  ena  of  the 
suoaivision  process. 

For  the  intensity  calculation  ana  the  occultation  Cshown  in  Figure  9), 
both  of  whicn  occur  in  parallel,  the  number  of  points  requiring  an 
intensity  calculation  woula  be  about  5  x  106  values.  This  allows 
for  some  of  the  6.8  x  106  values  to  be  discarded  before  the 
intensity  calculation.  This  portion  would  then  require  about  60 
charnels  of  the  bipolar  technology  approach,  or  about  eight  channels 
of  an  ECL  variety. 

Two  channels  of  intensity  memory  are  required  so  that  while  one  frame 
is  Deing  calculated,  the  other  is  being  display eo. 

The  overall  computational  efficiency  cannot  really  be  measureo  or 
comparea  with  present  eage-basea  systems.  It  is  possible  with  some 
new  techniques  for  eage-basea  systems  to  go  between  50,000  ana  400,000 
eages.  Oust  how  gooa  tnis  is  perceptually  ano  how  it  relates  to  the 
system  approach  is  unknown.  The  eage  approach  is  estimateo  to  take 
about  27,000  integrateo  circuits  (ICs),  whereas  the  estimated  number 
of  iCs  is  aoout  41,000.  The  justification  for  this  count  is  oasea  on 
the  report  by  Soland,  Voth,  and  Narendra  (1979).  In  the  report, 
approximately  8000  ICs  were  estimated.  Applying  the  factor  for  the 
number  of  channels  previously  estimated  to  the  parts  estimated  gives  a 
total  count  of  20,730  as  shown  in  Table  2.  A  safety  factor  of  two  for 
control  circuitry  is  applied  to  get  the  41,000. 

The  parts  described  in  Table  2  are  either  available  or  can  be 
available  in  hybria  packages.  For  instance,  toaay  there  are  no  16-bit 
aaoers  or  subtractors  commercially  available.  However,  the  five  chips 
requirea  for  the  adder/ subtractor  can  be  combined  into  a  single  hybrid 
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PaCKacje  if  tne  project  wcula  warrant.  The  lo-oit  multiplier  is 
available  touay,  as  are  tne  o4K  x  1  memory  cnips.  The  16-oit  latches 
can  ue  mace  from  two  6-oit  latches.  Also,  tne  shift  registers  can  be 
maoe  with  hycriu  tecnniques.  The  only  parts  not  reaoily  available  are 
trie  lo-oit  oiviaers.  The  units  oescrioec  in  Table  2  assume  that  the 
nyonaizatiGn  has  been  completed  for  the  aforementioned  functions. 

These  ILs  would  take  up  approximately  two  racks,  each  15  inches  wide 
uy  7  feet  high,  excluding  the  computer  system  in  our  system  concept. 
Tnis  amount  of  equipment  is  significantly  iess  than  present-cay 
systems. 

in  terms  of  impact  of  additional  windows,  the  primary  changes  take 
place  after  the  FOV  memory.  Hence  the  hardware  that  must  be 
duplicated  wouio  oe  ail  the  transformation,  test  subdivision 
naroware.  A  similar  argument  exists  for  two  different  eyepoints. 
however,  if  the  difference  between  eyepoints  is  not  great,  it  might  be 
possible  to  determine  an  error  amount  ano  simply  aojust  the  aata  that 
appears  at  tne  first  eyepoint.  This  could  be  investigated  further. 

In  the  eoge-baseo  system,  the  sort  must  be  on  the  polygon  structure. 

As  this  structure  gets  larger,  tne  amount  of  time  required  for  sorting 
does  not  increase  linearly  with  the  number  of  polygons.  Hence  a 
significant  amount  of  time  would  be  taken  up  simply  in  sorting  the 
oata. 


4.2  FUTURE  TRENDS 

This  section  has  concentrated  thus  far  on  using  the  parts  that  are 
commercially  available  in  the  bipolar  TTL  LSI  ana  ECL  LSI  chips,  or 
nyonos  from  those  chips.  Another  approach  is  to  use  MOS  techniques 
ana  go  to  very  large  integrated  circuits  (VLIC).  Clark  (I960)  is 
already  proposing  a  chip  he  describes  as  the  Geometry  Engine.  This 
chip  ooes  three  functions  which  are  common  to  computer  graphics: 
transformation,  clipping,  ana  scaling. 

The  system  concept  proposed  oy  Honeyweil  is  computationally  intensive 
in  the  transformation.  Such  technology  could  significantly  reouce  the 
amount  of  naroware  that  wouio  have  to  be  developed.  Honeywell  is 
pursuing  the  Development  of  chips  aimed  at  proviaing  the 
computational  efficiency  required  for  AVS5  as  well  as  other  optical 
systems.  Briefly,  the  cnip  will  ao  parallel  arithmetic  operations  on 
a  matrix  of  oata.  This  is  the  parallel  pipeline  architecture  required 
m  AVSS  to  provide  the  realism  lacking  in  today's  training  simulators. 
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SECTION  5 


CONCLUSIONS 


This  report  has  proviGea  the  results  of  an  investigation  into 
canaiaate  techniques  for  an  AVSS.  The  system  concept  as  a  result  of 
cnis  investigation  is  Daseo  on  the  Air  Force's  neeos  in  simulation. 

ujrrent  techniques  aisplay  polygonal  approximations  to  terrain 
surfaces.  Such  aisplay s  contain  little  or  no  texture,  no  shaoows,  ano 
few  special  effects.  The  low  fiaelity  of  polygonal  aisplay s  is 
effective  in  transferring  certain  skills,  like  air-to-grouno  weapons 
oeiivery,  but  is  ineffective  for  low-level  or  nap-of-the-earth  flight 
training  (Needham,  Edwards,  ana  Prather;  1980). 

The  AVSS  system  will  be  able  to  address  most,  if  not  all,  of  the 
important  training  aspects  required  of  the  next  generation  of  flight 
simulators.  Specifically,  the  system  algorithm  is  based  on 
high-fidelity  terrain,  texture,  and  shadow  representations;  and 
includes  the  capability  for  various  special  effects. 

Terrain  is  represented  as  a  smooth,  continuous  surface.  Both  its 
shape  ano  illumination  will  more  accurately  represent  true  terrain 
than  polygons.  Terrain  texture  will  be  simulatea  by  fractals,  which 
are  especially  suitable  for  training  in  low-level  flight,  because  the 
texture  smoothly  changes  in  level  of  detail  for  arbitrary  oistances 
while  maintaining  the  macroscopic  iaentity  of  the  texture. 

Furthermore,  the  texture  is  three-dimensional;  so  the  texture 
appearance  is  illumination-oepenaent,  and  it  can  be  appliea  to  moael 
forest  roofs  ana  other  irregular  terrain  features  auring  low-level 
f lignt. 

Tnere  is  some  perceptual  eviaence  that  the  aivergence  in  the  optical 
flow  fiela  of  terrain  texture  is  an  important  aistance  cue  (Koenaerink 
ana  van  Doom,  1976).  There  is  also  eviaence  that  local  information 
(for  example,  changes  in  textural  aetails)  is  processed  by  the  human 
visual  system  for  purposes  of  determining  direction  ana  velocity  of 
motion  (Regan  ana  Beveriy;  1978,  1979).  Thus,  aetailea  texture  may  be 
central  to  the  successful  simulation  of  the  real  worlo  ano  to  training 
tasks  where  accurate  distance  ana  direction  cues  are  needed. 

The  AVSS  system  provioes  for  the  generation  of  terrain  and  object 
shadows,  ooth  important  for  terrain  avoiaance  and  object 
identification.  Interactive  and  preprogrammed  moving  vehicles  can 
also  have  shaoows.  Since  the  hardware  for  shadow  generation  is 
iuentical  to  part  of  the  perspective  transformation  haraware,  little 
excra  cost  is  incurrea  when  many  moving  vehicle  shadows  are  required. 
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Ti^nslucence  effects  may  oe  moaeleo  in  tne  system  by  applying 
uifferent  weignts  to  the  intensities  of  the  occluding  ano  hiaaen 
surfaces  at  a  given  pixel,  ano  so  introouces  little  extra  cost. 

To  reouce  image  complexity  to  a  minimum,  an  artificial  horizon  is  usea 
in  tne  system.  Only  those  surface  elements  within  the  horizon  are 
uispiayeo.  The  system  concept  is  oescribeo  quantitatively  with  an 
assumeo  24-Km  maximum  raoius  horizon.  For  special  cases  of  flat 
terrain  ana  low-level  flight,  or  low  visibility,  the  horizon  may  oe 
arbitrarily  reoucea.  Smail  cultural  oojects  are  oisplayeo  only  when 
sufficiently  large  (pixel  size). 

Fuli-screen  anti-aliasing  is  included,  to  smooth  the  imagery  ana 
eliminate  "jaggies,"  flickering,  and  other  disturbing  artifacts.  It 
should  also  be  notea  that  this  system  presents  a  minimum  of  straignt 
edges,  which  generate  tne  most  severe  aliasing  artifacts.  In  other 
worus,  current  systems  maximize  their  aliasing  problems  because  they 
display  straight  eages  of  polygons.  The  AVSS  system  represents  shadow 
terminators,  texture  borders,  and  terrain  by  smooth  or  irregular 
eoges,  ana  so  inherently  minimizes  aliasing.  The  cost  of  full-screen 
anti-aliasing  is  fairly  high  but  no  adequate  alternative  exists  if 
fractal  textures  are  used.  For  reasons  stated  above,  the  potential 
training  advantages  of  using  fractals  were  felt  to  outweigh  all  other 
concerns. 

The  advantages  ana  disadvantages  of  the  display  algorithm  are 
summarized  as  follows. 

5. 1  ADVANTAGES 

1.  Because  bicubic  B-spline  surfaces  represent  the  terrain 
surfaces,  real-world  contours  are  mooeled  more  accurately 
than  witn  polygons. 

2.  No  sorting  is  required  to  determine  patch  maxima.  This 
avoids  numerical  techniques  which  occasionally  incur 
singularities. 

3.  Bicubic  and  fractal  subdivisions  are  logical  extensions  of 
the  mission  quau  tree  subdivision.  The  transition  from  the 
stored  quad  tree  to  the  computed  quad  tree  can  be  transparent 
to  the  algorithm  implementation.  This  provioes  a  unified 
approach  and  a  clear  flow  of  logic  from  the  root  nooe  to  the 
smallest  aisplayable  subpatch. 

4.  Fractal  subdivisions  used  for  textures,  texture  borders,  ana 
shadow  borders  can  be  computed  in  parallel  with  bicubic 
subdivision,  adding  no  time  to  the  display  algorithm. 
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Tr.e  overall  algorithmic  approacn  is  unified  because 
suuaivision  is  appiiea  to  ootain  smooth  curveo  surfaces, 
irreguiar-texturea  surfaces,  texture  Poraers,  shadow  ooraers, 
ana  appropriate  pixel  size  resolution  for  terrain  ana 
cultural  objects. 

o.  Fractal  texturing  provides  an  arbitrary  ana  automatic  level 
of  oetail  while  maintaining  the  macroscopic  identity  of  a 
texture.  It  is  the  best  available  simulation  technique  for 
iow-ievel  flight  scenarios. 

7.  A  z-Duffer  is  usea  to  solve  the  hiaoen  surface  problem. 

Other  techniques  neea  to  sort  iists  of  entities  to  solve  the 
niaaen  surface  problem.  The  sorting  can  oecome  a  major 
factor  in  real-time  consiaerations,  limiting  tne  numoer  of 
polygons  or  patches  sorted. 

8.  Each  speciaiizeo  technique  can  be  flexibly  implementea. 

Thus,  shaaows  can  be  appiiea  or  withheia;  cultural  oojects 
can  oe  aoaea  or  witrmela,  ana  textures  may  or  may  not  oe 
appiiea  in  any  part  or  all  of  the  oata  base. 

Off-line  preparation  of  the  oata  case  for  register  squares 
ana  texture  is  inaepenaent  of  the  mission;  that  is,  the 
preparation  is  inaepenaent  of  the  sun  position.  Off-line 
preparation  can  be  hanalea  quickly  because  the  affine 
transformation  is  alreaay  in  part  of  the  real-time 
perspective  transformation  haraware. 

10.  The  nature  of  the  subdivision  process  allows  avoidance  of  the 
cross  and  act  praaucts  taken  for  the  surface  normal  vector 
ano  aiffuse  intensity;  insteaa,  a  simpler  aod  and  shift 
process  is  usea. 

11.  Sicuoic  ana  fractal  subdivision  processes  are  very  quick, 
using  only  aoa,  suotract,  ana  shift  operations. 

DISADVANTAGES 

1.  Anti-aliasing  is  difficult  because  the  surfaces  which  must  be 
usea  in  anti-aliasing  become  available  at  different  times. 

Z.  As  a  patch  is  subdivided,  the  space  requirements  grow  rapialy 
for  storing  register  squares.  Aujacent  patches  with  common 
corners  must  have  separate  register  squares  because  the 
squares  will  contain  values  representing  different  levels  of 
subdivision. 

3.  The  cubic  surface  may  not  be  appropriate  for  all  surfaces. 
Flat  surfaces  may  oe  rendered  with  slight  unaulations  due  to 
adjacent  patches  which  have  some  curvature. 


In  orGer  to  auaress  these  arawoacks,  the  following  are  recommenaea: 

Tne  texture  approacn  cnosen  ooes  provice  the  necessary  realism. 
Textures  shouio  oe  generatea  ana  evaluatea  over  a  preoetermlnea  flight 
patn  witn  several  aifferent  textures.  Then  tnis  sequence  snoula  be 
snown  to  pilots  to  verify  that  perceptual  cues  are  inoeea  ootainea 
from  these  texture  surfaces.  Anti-aliasing  wili  be  applieo  over  the 
image.  During  the  simulation,  an  estimate  can  oe  maae  of  how  long  it 
takes  the  various  surfaces  to  be  avaiiaDie. 

Secono,  tne  simulation  will  neip  to  aetermine  now  much  intermeaiate 
storage  is  requirea  curing  the  suoaivision.  A  significant  numoer  of 
memory  chips  has  aireaay  Deen  allocatec  for  the  function,  it  is 
oesiraDle  to  reauce  tnis  component  count. 

Thira,  tne  inoucea  curvature  to  real,  smooth  surfaces  causea  by 
aajacent  real  patches  which  do  have  slight  curvature  needs  to  be 
evaiuateo. 

in  general,  before  committing  to  a  full-scale  haraware  development, 
certain  areas  shoula  oe  simulatea  ana  evaluatea.  A  preliminary  aesign 
might  oe  a  part  of  the  simulation.  The  results  will  be  positive  for 
the  texture  approach  chosen. 
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APPENDIX  A 


OTHER  OLuULTATIGN  TECHNIQUES 


As  stated  in  tne  main  report,  the  z-buffer  technique  is  requirea  for 
tne  Catmuli  suoaivision  methoo  useo  in  surface  representation.  The 
z-ouffer  is  requirea  Pecause  the  subdivision  method  produces  pixels  in 
a  random  order.  Other  surface  representation  techniques  alj.ow  other 
occuitation  techniques,  but  usually  there  is  one  occultation  methoo 
notably  more  appropriate  for  a  given  surfacing  methoo.  In  ether 
words,  surface  representation  ano  occultation  techniques  are  closely 
related  ano  sometimes  inseparable. 

Sutherland,  et  al.*  have  shown  that  occultation  is  essentially  a 
sorting  problem.  They  categorize  techniques  accoroing  to  wnere,  when, 
anu  what  is  sorted.  Techniques  have  been  devisee  to  sort  in  object 
space  or  image  space,  to  sort  on  z,  sorting  on  eoges,  patches,  faces, 
or  clusters.  Most  methods  attempt  to  take  advantage  of  some 


coherence.  There  are  eight 

kinos  of  coherence: 

1. 

Frame 

5. 

Impliea-edge 

• 

Ooject 

6. 

Scan-line 

3. 

Face 

7. 

Area 

4. 

Edge 

8. 

Depth 

For  AVSS,  the  teennigues  which  use  scan-line  coherence  make  some 
sense.  Lane,  et  alJ  describe  the  more  promising  scan-line 
techniques  for  parametrically  aefinea  surfaces.  There  are  advantages 
ana  aisaavantages  to  these  but  not  on  the  basis  of  their  occultation 
method.  All  the  occultation  methods  work  if  they  are  properly  paired 
off  with  the  surface  representation  methods. 


*1.E.  Sutherland,  R.F.  Sproull  and  R.A.  Schumacker,  "A 
Characterization  of  Ten  Hiaaen  Surface  Algorithms,"  ACM  Computing 
Surveys,  Vol.  6,  No.  1,  March  1974. 

+J.M.  Lane,  L.C.  Carpenter,  T.  whitted,  ano  J.F.  Blinn,  "Scan 
Line  Methods  for  Displaying  Parametericaily  Defined  Surfaces,"  CACM, 
Vol.  23,  No.  1,  January  1980,  pp.  23-24. 
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APPENDIX  a 


alternative  texturing  techniques 


Three  texturing  techniques  which  were  considerea  inappropriate  for 
AVSS  for  perceptual  or  implementation  reasons  are  aiscussea  nere: 

1 .  Markov  processes 

2.  Texture  tnes 

3.  Random  mapping 

MARKOV  PROCESSES 

A  yraytone  texture  pattern  can  be  generated  by  a  so-calleo  Markov 
chain.  Tne  ioea  is  to  generate  a  sequence  of  tones  using  the  probable 
Knowledge  of  some  given  tone  occurring  after  some  previous  tone  or 
tones.  Axi  that  is  neeaed  is  a  few  initial  gray  values  ano  a  set  of 
prooaoilities,  the  latter  from  an  arbitrary  textureo  image  obtaineo 
ana  analyzea  beforehana. 

Au vantages 

Storage  is  minimal  ana  the  sequential  generation  technique  is  fast. 
Disao vantages 

1.  Not  all  textures  can  be  approximateo  by  Markov  chains. 

2.  The  texture  aefineo  by  a  Markov  chain  applies  to  only  one 
level  of  oetail.  Markov  chains  for  the  other  levels  are 
troublesome  because  a  given  texture  area  may  be  viewea  at 
different  levels  of  oetail  simultaneously,  requiring  either 
averaging  of  a  high-resolution  chain  or  an  intricate 
combination  of  multiple  chains. 

3.  There  is  no  inherent  continuity  in  Markov  synthesized 
textures  if  ioentical  probabilities  are  usea  to  generate 
similar  textures  on  aajacent  patches.  Therefore,  assigning  a 
Markov  chain  to  each  patch  will  result  in  a  patch-like 
appearance . 

4.  Markov  synthesis  is  a  serial  proceoure,  not  gearea  to  a 
subdivision  algorithm. 
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TEXTURE  TILES 


The  most  advanced  study  dealing  with  periodic  textures  (texture  tiles) 
is  that  of  Stenger,  et  al.*  They  demonstrate  a  texture  tile 
methodology  which  dienes  the  tiles  together  and  eliminates  any 
periodicities.  The  blending  also  eliminates  the  detail  in  the 
original  image,  causing  a  blurry,  indistinct  texture  which  no  longer 
resemoles  tne  original. 

RANDOM  MAPPING 

Random  ana  periodic  textures  such  as  those  of  Schacter*  are  crude 
representations  of  terrain  textures,  employing  sinusoids  or  Gaussian 
random  fields  (or  both).  To  avoid  unaersampiing,  current  systems 
display  textures  at  10  levels  of  detail.  Such  textures  generally  have 
little  resemblance  to  the  real  world  because  of  their  notable 
periodicity . 


T.  Stenger,  W.  Dungan  ano  R.  Reynolds,  "Computer  Image 
Generation  Texture  Study,"  AFHRL-TR-79-2,  AD-A074  019. 
Wnght-Patterson  AF8,  OH:  Advanced  Systems  Division,  August  1979. 

+B.  Schachter,  "Long-Crested  Wave  Models,"  Computer  Graphics 
ana  Imaae  Processing.  Vol.  12,  No.  2,  February  1980,  pp.  187-200. 
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APPENDIX  C 


IMAGE  SPACE  VS  OBJECT  SPACE 


One  of  the  central  considerations  in  AVSS  was  whether  to  subdivide 
patches  in  image  cr  object  space.  In  object  space  (tne  choice  here), 
suuoivision  of  both  fractals  ana  bicubics  is  scalar;  that  is,  there 
is  oniy  a  one-aimensional  subdivision,  in  image  space,  bicubic 
subdivision  is  vector  (three-dimensional),  requiring  more  hardware  in 
parallel.  Furthermore,  there  is  no  parametric  functional  form  for 
fractals  as  there  is  for  bicubics.  Because  of  this,  fractal 
suDoivision  in  image  space  nas  no  aefineo  methodology  at  this  time 
(tnougn  one  may  be  developed  in  the  future).  Even  with  the  aovent  of 
image  space  fractal  subaivision,  vector  subdivision  of  fractals  will 
ue  required  ana  fractal  look-up  table  values  wiii  probably  become 
non- integer. 

State-of-the-art  fractals  can  be  created  in  object  space  for  the 
purpose  of  generating  perturbeo  surface  normals  oniy,  ignoring  the 
perturbed  fractal  elevations  themselves.  The  normals  can  then  be 
applied  in  image  space  to  determine  surface  intensities.  The  result 
will  be  a  smooth,  bicubic  surface  with  the  appearance  of  a  fractalea 
texture.  In  any  event,  image  space  subaivision  requires  finding  the 
object  space  normals;  that  is,  it  requires  scalar  bicubic  and  fractal 
subdivision.  With  no  perturbed  elevations,  three-dimensional  trees, 
forests,  mountains,  clouds,  etc  cannot  be  created — a  disadvantage  of 
tne  image  space  method. 

in  addition  to  tne  arguments  expressed  above,  the  primary  advantage  of 
image  space  subdivision  is  that  it  requires  only  =  40,000 
perspective  transformations  per  frame  time,  as  opposed  to  ooject  space 
subdivision,  which  requires  «  )  x  iO6. 

On  the  other  hano,  register  squares  are  computed  off-line  for  object 
space  subdivision  ana  are  recomputeo  each  frame  time  for  image  space; 
that  is,  48  aojacent  elevations  must  be  accessed  (16  each  of  Xg, 

Ye,  ie)  ano  3  x  40,000  register  squares  formeo  each  frame  time. 

In  the  latter  case  xt  would  be  inefficient  to  first  obtain  the  120,000 
register  squares  eacn  frame  time  ana  then  perform  subdivision  on  their 
respective  patches.  This  would  require  large  temporary  storage.  More 
efficiently,  the  process  woulo  be  pipelined  so  that  as  a  triple  of 
register  squares  was  formed,  subaivision  of  their  patch  would  begin. 
This  implies  tnat  patches  would  be  projected  and  subaivioea  in  screen 
(image)  space  in  the  same  oraer  that  register  squares  are  computed; 
that  is,  in  a  sequential  overlapping  oraer.  Object  space  subaivision 
would  be  more  flexible  since  the  register  squares  already  exist.  For 
example,  projection  ana  subaivision  could  be  oraerea  in  such  a  way 
that  patches  closer  to  the  observer  are  treated  first. 


Object  space  subdivision  was  chosen  because  it  allows  three-dimensional 
fractal  texturing,  because  bicubic  subai vision  hardware  is  rather 
expensive  ana  four  times  as  much  hardware  is  needed  in  image  space 
(3(x,y,z)  +  1  intensity),  ana  because  data  management  is  more  flexible 
in  ODject  space. 
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APPENDIX  D 


OTHER  SURFACE  REPRESENTATION  ALGORITHMS 


Several  algorithm  alternatives  which  were  considered  for  AVSS,  but 
aiscaraea,  are  summarized  nere.  To  clarify  comparisons,  advantages 
ana  aisaavantages  are  listed  for  each  algorithm.  In  each  case,  the 
disadvantages  seemea  to  outweign  the  advantages.  Catmull's  original 
aiganthm  was  the  oasis  for  the  Honeywell-Catmull  algorithm  cnosen  for 
MSS. 

CATMULL  ALGORITHM 

Though  many  of  the  techniques  of  the  original  Catmull  algorithm  were 
incorporated  into  the  Honeywell-Catmull  algorithm,  there  are  several 
important  differences  between  the  two.  For  convenience,  these 
aigoritnms  are  aDbreviatea  as  CA  ana  H-CA. 

In  the  CA  patch,  subdivision  is  continued  until  only  one  pixel  center 
is  covered.  In  the  H-CA  patch,  subdivision  is  halted  when  the  patch 
is  a  certain  size  (pixel  size).  The  CA  determines  patch  surface 
normals  by  taking  surface  derivatives  whereas  the  H-CA  determines 
surface  normals  through  a  quick  recursive  process. 

uA  ADVANTAGES 


1.  Oust  as  with  the  H-CA,  bicubic  subdivision  allows  high 
resolution  everywhere  on  the  screen. 

2.  Terrain  is  smoothly  approximatea. 

3.  The  z-ouffer  provides  a  powerful  occultation  test  ana  is  not 
subject  to  the  potential  flaws  of  hiooen  surface  algorithms. 

CA  DISADVANTAGES 

1.  Determining  surface  normals  with  derivatives  is  slow. 

2.  Stopping  subdivision  when  a  patch  covers  one  pixel  center 
aoes  not  ensure  that  the  patch  will  be  pixel  size.  In  some 
cases,  such  patches  may  exteno  over  several  pixel  dimensions 
ana  still  cover  only  one  pixel  center.  This  can  leaa  to  a 
faceted  surface  appearance  in  some  cases. 

3.  No  provision  is  made  for  anti-aliasing,  realistic  texturing, 
or  shaoows. 
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SoAn-laNl  hlGGkITHmS* 

Traoitionally ,  terrain  has  been  simuiateo  by  a  collection  of  polygons 
oispiayea  in  scan-line  oraei .  Defining  screen  space  coorainates  as  x 
going  to  tne  right,  y  going  up,  ana  z  going  into  tne  screen,  a 
scan-line  algorithm  consists  of  two  nesteo  loops  Ian  x  loop  ana  a  y 
loop).  During  the  y  loop,  tnree-aimensional  polygons  are  intersecteo 
with  constant  y  planes,  resulting  in  a  set  of  line  segments  in  xz. 
During  the  x  loop  these  line  segments  are  intersecteo  with  a  ray 
aefineo  uy  the  eyepomt  ana  a  screen  picture  element,  iesuiting  in  a 
set  of  one-oimensional  points.  These  points  are  then  sorteo  in  z  with 
the  smallest  z  being  visible. 

To  make  this  scheme  practical,  polygons  must  be  sorteo  in  y  before 
Display  to  avoia  consulting  a  list  of  all  polygons  eacn  frame  time. 
Sometimes  an  x  sort  is  macje  before  z  sorting,  sometimes  the  reverse. 

POLYGON  ALGORITHMS 

There  are  many  variations  of  polygon  scan-line  algorithms. +  A 
common  element,  however,  is  the  representation  of  terrain  surfaces  by 
fiat,  polygonal  surfaces. 

Ao vantages 

i.  Polygon-scan  line  algorithms  are  fairly  inexpensive,  partly 
oecause  straight  lines  are  easy  to  oeal  with  ana  partly 
because  haraware  alreaay  exists  for  polygon  display. 

z.  Intensities  for  truly  flat  surfaces  are  computed  only  once 
for  the  entire  surface.  To  approximate  a  curved  surface, 
intensity  interpolation  can  be  employee. 

3.  Mappea  textures  can  be  easily  applied. 

A.  Perspective  transformations  are  minimizeo  because  only 

polygon  vertexes  require  a  transformation.  Screen  x,  y,  and 
z  polygon  coordinates  may  oe  generated  incrementally. 

3.  Anti-aliasing  is  easier  to  apply  because  all  surface  elements 
for  a  pixei  are  available  at  one  time,  rather  than  ranaomly 
with  a  z-ouffer. 


^Polygon,  81in,  Whitted,  Lane-Carpenter,  Clark,  Biquaaratic 


+I.E.  Sutherlana,  R.F.  Spioull,  ana  R.A.  Schumacker,  "A 
Characterization  of  Ten  Hiooen  Surface  Algorithms,"  ACM  Computing 
Surveys,  Vol.  6,  No.  1,  March  1S7A. 
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ulSouVanllaydS 

x.  Sxincuectes  are  compcsea  of  straignt  lines. 

x.  Gourano  snaaing;  tnat  is,  the  interpolation  of  intensities, 
allows  a  Mach  bana  effect.  The  more  sophisticatea 
interpolation  of  vector  normals  (Phong  shaaing*  eliminates 
this  effect  but  is  more  expensive. 

3.  Ail  polygons  representing  the  terrain  must  be  storeo. 

Comparea  to  the  information  in  bicubic  patch  register 
squares,  the  polygon  oata  base  is  not  compact. 

4.  Polygon  algorithms  aepena  largely  on  texture  mapping.  Tnis 
technique  requires  large  oata  storage,  nas  a  finite 
resolution,  ana  is  only  two-aimensianai. 

If  fractals  were  applieo  to  polygons,  a  supervision  process 
woulo  oy  oefinition  be  requirea.  But  if  fractal  suoaivision 
were  usea,  then  bicubic  suoaivision  of  curved  terrain 
surfaces  could  just  as  well  be  implemented  in  parallel,  with 
rittie  extra  cost  ana  the  benefit  of  aaoed  realism.  Note 
that  as  fractals  were  applieo  to  polygonal  surface,  some 
interpolation  of  intensities  wouio  probably  still  be 
necessary  to  avoia  Mach  bands,  whereas  with  a  curvea  bicubic 
surface  under  the  fractal  perturbations,  no  interpolation 
woulo  oe  necessary. 

5.  The  size  of  terrain-representative  polygons  is  iimitea  Doth 
by  storage  anu  sorting  constraints. 

6.  Polygon  sorting  algorithms  are  occasionally  subject  to 
ambiguities  ana  singularities. 

BLiNN  ALGORITHM 

This  algorithm  scans  curved,  parametrically-oefineo  patches  rather 
than  polygons.  As  in  a  polygon  scheme,  a  y  sort  is  necessary  for 
efficiency.  In  a  polygon  scheme,  polygons  are  sorted  according  to  the 
highest  y  value  on  the  polygon.  This  is  inevitably  the  y  value  of  its 
hiynest  vertex.  Thus,  only  the  polygon  vertexes  neeo  to  be 
consioreo.  dlinn^  attempts  a  sort  according  to  the  maximum  y 
value  of  a  curvea  patch. 


*o.T.  Phong,  "Illumination  for  Computer-Generateu  Pictures," 
uACM ,  Vol.  i6,  No.  6,  June  1975,  pp.  311-317. 


+ j.F.  Blinn,  "Computer  Display  of  Curved  Surfaces,"  Doctoral 
aissertation,  University  of  Utah,  December  1978. 
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Muvantaqes 

i.  curved  surfaces  are  Gispiayea,  aoaing  more  reansm. 

All  cne  efficiency  aavantages  of  scan  line  aigoritnms  iisteo 
unuer  polygon  aigoritnm  aavantages  hoxa. 

uisaavantaqes 

1.  Because  alx  parts  of  a  curvea  patch  may  potentially  De 
maxima,  the  maxima  tests  are  quite  oifficult  to  implement. 
Generally,  iterative  techniques  are  employee,  out  even  tnese 
fail  or  are  amoiguous  when  aeaiing  with  saaule  points,  cusps, 
ana  nan-monotonic  curves  ana  silhouettes.  Consequently,  when 
oealing  with  the  generation  of  the  real  woria,  no  guarantees 
can  be  maae  as  to  the  accuracy  of  the  simulation. 

2.  Fractal  texture  ana  shaaow  algorithms  cannot  easily  be 
appliea  since  they  involve  a  subaivision  methocology. 

wHxTTED  Algorithm 

wmtteo*  avoias  some  of  the  aifficulties  in  Blinn’s  algorithm  by 
approximating  a  curvea  (bicubic)  patch  oy  the  four  patch  eoges. 
Furtnermore,  cubic  curves  are  generated  as  approximations  to 
silhouettes  whenever  necessary  (see  Figure  D-l). 


INTERNAL 

SILHOUETTE 


Figure  D-i.  Whittea  approximates  internal 
silhouettes  with  cuoic  curves. 


*G.T.  whitteo,  "A  Scan  Line  Algorithm  for  Computer  Display  of 
Curvea  Surfaces,"  Proceeoinqs,  3th  Conference  on  Computer  Graphics  ana 
Interactive  Techniques,  Atlanta,  GA,  1978. 
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i.  in  sedition  to  scan  line  advantages,  patch  edge  maxima  are 
easier  to  determine  tnan  the  internal  maxima  in  Blinn's 
algorithm. 

1.  Snaoow  silhouettes  may  also  be  oetermineo  by  this  technique. 
disadvantages 

1.  Since  the  generation  of  a  cuDic  silnouette  is  inaccurate  for 
higniy  curveo  patches,  a  curvature  test  is  necessary. 

2.  As  in  the  3iinn  algorithm,  an  iteration  technique  is  usea  to 
oetermine  silhouette  enapoints,  ana  necessarily  suffers  from 
singularity  problems.  Some  of  the  conditions  unoer  wnich  the 
Wnittea  algorithm  fails  are  illustrateo  in  Figure  D-2. 

lANE-lARPENTER  ALGORITHM 

Tins  algorithm  is  a  combination  of  scan-line  ano  subdivision 
teenniques.  in  it,  patches  are  sorted  by  their  maximum  possible  y 
values.  At  each  scan  line,  patches  are  subaivioeo  until  no  subpatch 
overlaps  the  scan  line  (that  is,  when  the  subpatch  is  approximately 
pixel  size).  Subaivision  can  also  be  halted  if  the  patch  is  within 
some  set  toierance  of  being  a  planar  polygon.  In  either  case,  when 
subaivision  is  stoppea,  the  patch  will  be  treated  as  a  polygon  ano 
processed  with  a  polygon  scan-line  algorithm. 


Figure  D-2.  Three  examples  of  silhouettes  which  the 
Whittea  algorithm  does  not  treat. 
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The  aovantage  of  trus  algorithm  lies  in  its  anility  to  minimize  the 
numoer  or  suDQivisions  oy  making  a  quick  flatness  test.  Althougn 
"hoies"  sometimes  can  appear,  the  Lane-Carpenter  algorithm  '  is 
quite  successful  when  usea  to  generate  simple  curvea  objects  at  a 
fairly  constant  oistance. 


bisao vantages 

1.  Unaer  worst-case  conoitions  (low  sun  angle  ana  bumpy 

terrain;,  most  patches  wij.j.  require  subdivision  gown  to  a 
fine  resolution.  Thus  tne  flatness  test  wiii  be  a  liability. 

z.  Suppose  a  iarge,  flat  area  is  approximatea  by  a  single 

polygon.  This  inherently  aisailows  the  construction  of  any 
texture  witn  the  polygon.  In  other  woros,  a  flatness  test  is 
useful  oniy  when  no  texture  is  present. 

3.  The  maximum  possible  y  value  of  a  patch  is 

viewpoint-oepenaent  ana  so  must  be  located  each  frame  time. 
The  methoa  by  which  y  maximum  is  locatea  for  a  patch  involves 
taking  many  secono  aerivatives,  which  is  a  tremendous 
liability  for  real-time  simulations.  An  enclosing  box  is 
quicker  but  leads  to  sorting  ambiguities. 

aiWUADRATIC  ALGORITHMS 

Hoaeiing  "free-form"  terrain  (that  is,  terrain  with  arbitrary 
elevations)  is  best  acccmplishea  with  bicubic  patches.  Biquaoratic 
patcnes,  though  simpler  mathematically,  produce  discontinuities  across 
patch  boraers.  Biquaaratics  are  suitable  only  for  a  limitea  class  of 
cultural  features. 


CUBE  INTERSECTION  ALGORITHM 


An  alternative  algorithm  for  AVSS  is  the  so-called  cube-intersection 
algorithm.  The  idea  central  to  this  algorithm  is  the  creation  and 
storage  of  the  entire  mission  aata  base  off-line  in  a  tree  structure 
of  cuoes.  The  largest  cubes  woulo  be  400  meters  on  a  side.  Each 
400-meter  cube  woulo  contain  eight  200-meter  cubes,  each  200-meter 
cuoe  eight  iOO-meter  cubes,  ana  so  forth. 


*j.M.  Lane  ana  L.C  Carpenter,  "A  Generalized  Scan-Line  Algorithm 
for  the  Computer  Display  of  Parametrically-Oefineo  Surfaces,"  Computer 
Graphics  ana  Image  Proceeding,  Vol.  11,  1979,  pp.  290-297. 

+J.M.  Lane,  L.C.  Carpenter,  T.  Whitted,  and  J.F.  Blinn,  "Scan 
Line  Methoos  for  Displaying  Parametrically-Definea  Surfaces."  CACM, 
Vol.  23,  No.  1,  January  1980,  pp.  23-34. 
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Mxi  cuues  are  either  "empty"  or  "non-empty."  If  no  ooject  (.or  no  part 
o t  an  uoject)  fails  within  a  cuoe,  it  is  given  an  empty  aesignation. 
if  a  cuoe  contains  part  of  the  terrain  surface  or  part  or  wnole  of  a 
cuxturai  ooject,  tne  cuoe  is  non-empty. 

Tne  algorithm  provides  for  the  off-line  generation  of  a 
oicuoic-fractaleo  surface  on  which  tne  cuoe  tree  structure  can  be 
supenmposea.  Off-line  suoaivisron  of  the  terrain  surface  results  in 
a  collection  of  small  (2-meter;  suopatches.  If  any  one  suopatcn 
vertex  fails  within  a  cuoe,  tne  cuoe  is  non-empty. 

Thus,  the  proceoure  for  off-line  generation  of  a  terrain  surface 
cescrioeo  in  a  cuoe  tree  structure  woulo  be: 

1.  Determine  bicubic  ana  fractal  coefficients. 

2.  Subaiviae  the  entire  terrain  surface  oown  to  a  2-meter 
resolution. 

3.  Superimpose  a  cube  tree  structure  over  the  wnole  mission  aata 
c-ase. 

4.  Determine  all  empty  ana  non-empty  2-meter  size  cubes. 

3.  calculate  aiffuse  intensities  for  all  2-meter  patches  ana 
assign  these  intensities  to  the  2-meter  size  cubes. 

6.  Average  cube  intensities  ano  assign  to  larger  cubes  higher  up 
tne  tree. 

7.  Designate  as  non-empty  any  larger  cube  containing  a  non-empty 
cube. 

in  tne  ena  of  the  off-line  preparation,  all  the  mission  aata  are 
storea  in  optical  oiscs  ana  are  reaay  for  real-time  access.  All 
textures,  shadows,  cultural  objects,  etc  have  been  assignea  in  the 
off-line  generation. 

The  real-time  accessing  of  these  data  is  accomplisheo  with  a  ray 
tracing  technique.  For  each  pixel  on  the  display,  a  ray  projects 
outwara  from  the  pilot  ana  intersects  cubes. 

1.  If  a  ray  intersects  an  empty  cube,  it  proceeds  to  the  next 
cube. 

2.  If  a  ray  intersects  a  non-empty  cube,  the  eight  sub-cubes  are 
accessea  ana  those  intersectea  by  the  ray  are  testeo  for 
emptiness  or  non-emptiness. 

3.  At  the  intersection  of  a  ray  ano  an  opaque  cube,  the  cube 
intensity  is  written  into  the  pixel,  ana  the  next  ray  is 
generated.  An  opaque  cube  is  a  non-empty  cube  no  smaller 
than  pixel  dimensions;  that  is,  cube  opacity  is  a  function 
of  pilot-terrain  distance,  ano  is  useo  to  avoid  having  all 
rays  proceea  to  the  2-meter  resolution. 
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1.  Because  rays  stop  at  the  first  surface  of  intersection,  no 
niooen  surfaces  are  aeait  with. 

2.  Recursive  perspective  transformations  and  subaivisions  are 
avoiueo;  that  is,  no  tests  for  patch  size  in  screen  space  are 
necessary . 

3.  Fiat  or  spherical  screens  may  De  useo  quite  easily.  In  the 
spherical  case,  rays  are  generateo  so  that  all  pixels  subteno 
equal  angles  from  the  viewer's  eye. 

4.  Tne  rays  are  generateo  in  scan-line  order.  Scan-iine 
naroware  is  generally  faster  ana  cheaper  than  ranaom  access 
naroware. 

5.  No  clipping  is  requirea  since  the  only  aata  consiaered  are 
tnose  oata  struck  by  a  ray. 

o.  Anti-aliasing  may  be  implementea  oy  simply  having  several 
rays  per  pixel  ana  averaging  the  intensities  of  the  surfaces 
(cubes)  they  strike.  Since  an  enclosing  rectangle  is 
avoiaea,  small  sampling  errors  are  avoioea. 

7.  Z-buffer  memory  requirements  are  minimal  because  the  pixels 
are  assignea  intensities  in  scan-line  oraer.  As  soon  as  one 
row  of  pixels  is  filled,  the  oata  may  be  reaa  out  for  aisplay 
ana  a  single-row  z-buffer  fillea  again. 

8.  Since  most  of  the  terrain  is  modeleo  by  diffuse  reflection 
ana  tne  aiffuse  intensities  have  teen  calculated  off-line, 
virtually  no  intensity  calculations  are  requirea  during  real 
time. 

Disadvantages 

1.  Ray  intersection  calculations  are  time-consuming  and  the  tree 
search  is  difficult  to  implement.  A  typical  ray  requires  six 
divides,  one  multiply,  ana  roughly  100  aaas.  Although 
several  rays  can  be  computed  in  parallel,  each  ray  must 
search  through  a  tree  structure  of  cubes  in  a  way  that  cannot 
oe  predetermined. 

2.  Rays  which  project  at  a  slight  angle  with  respect  to  the 
horizontal  may  travel  through  a  large  number  of  cubes  before 
intersecting  an  opaque  cube.  In  such  cases,  on  the  order  of 
300  aao  operations  auring  the  tree  search  may  be  requirea. 

3.  If  terrain  is  approximated  by  cubes  of  pixel  size,  staircases 
will  appear  along  silhouette.  Subpixel  cubes  woulo  then  seem 
necessary. 
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a.  witn  a  smallest  cube  size  of  z  meters,  nearby  objects  auring 
low-ievel  flignt  will  appear  unrealistic  and  olocky,  besioes 
enhancing  staircase  jaggies  because  of  the  predominance  of 
straignt  lxne  segments. 

5.  The  mission  aata  base  ana  high-speea  local  memories  must  be 
enormous.  A  z -meter  resolution_48  x  800  km  mission  data  base 
would  require  approximately  iO-^  bits.  The  local  circular 
high-speea, memory  neeaeo  each  frame  time  would  contain 
roughly  10*-°  bits.  This  is  approximately  two  oroers  of 
magnitude  larger  than  the  circular  hign-speeo  memory  employ ea 
in  tne  Catmull-Honeywell  algorithm.  Each  frame  time,  a 
certain  number  of  cubes  must  be  transferred  from  disc  to 
high-speea  memory,  equal  to  106  bits/frame  time.  This  data 
transfer  rate  is  quite  nigh  ana  difficult  to  implement.  In 
the  Catmuil  algorithm,  oniy  a  few  thousand  bits  are 
tiansferrea  each  frame  time. 

Ail  of  the  above  disadvantages  can  be  reaucea  somewhat  by  implementing 
a  "rings  of  resolution"  structure  which  places  the  highest  detail  near 
tne  pilot  anu  rower  aetail  further  away.  This  structure  would 
decrease  storage  ana  aata  transfer  rate  requirements  but  would  aaa 
some  complexity.  Because  the  aisaavantages  appear  to  outweigh  the 
advantages,  the  cube  algorithm  will  not  be  useo. 

PERSPECTIVE-STORAGE  ALGORITHM 

Rather  than  store  all  mission  data  in  great  aetail  in  cubes,  it  coulo 
ue  storea  as  patches  and  subpatches.  Thus,  the  whole  data  base  woulo 
consist  of  z -meter  size  patches,  stored  in  a  tree  structure.  When 
neeaeo,  a  branch  containing  a  given  resolution  patch  woulo  be 
projected  to  screen  space.  Thus,  rings  surrounding  the  pilot  (ana 
moving  with  the  pilot)  wouia  be  useo  to  access  terrain  patches  at  some 
adequate  (pixel)  resolution.  A  circular  fast  memory  ana  disc  mission 
memory  wouia  be  necessary.  Both  would  be  as  large  as  the  memories  in 
the  cube  intersection  algorithm. 

Advantages 

1.  No  subdivision  is  neeaeo  in  real  time. 

z.  No  intensity  calculation  (except  for  an  atmospheric  factor) 

is  neeaea  in  real  time. 

Oisaovantaqes 

1.  Compared  to  the  suggested  Catmull-Honeywell  algorithm,  this 
methoo  requires  more  perspective  transformations  per  frame 
time  because  each  ring  of  resolution  must  transform  one  patch 
size  to  the  screen  ana  since  the  closest  patches  in  the  rings 
must  be  no  larger  than  pixel  size,  all  more  distant  patches 
in  a  ring  will  ue  projected  at  subpixel  size. 
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2.  Cube  algorithm  disadvantages  4  and  5  hold  for  this  algorithm: 

Because  of  these  disadvantages  and  because  no  2-buffer  or 
anti-aliasing  problems  are  solved,  the  perspective-storage  algorithm 
is  not  an  optimal  algorithm. 

CURVATURE  TEST  ALGORITHM 

To  avoid  excessive  storage  and  save  on  certain  calculations,  terrain 
patches  could  be  subdivided  off-line  until  their  curvature  is  such 
that  the  approximation  of  the  subpatches  as  polygons  does  not  leave  a 
fractalea  appearance.  Then  only  polygons  will  be  stored,  not  register 
squares.  During  real  time,  bicubic  subdivision  is  avoided,  and  only 
fractal  subdivision  is  applied.  Perspective  transformation,  fractal 
subdivision,  and  rectangle  tests  are  conducted  as  usual. 


Advantages 


1.  Less  storage  is-  required  in  both  disc  and  high-speed  memories 
than  with  a  2-meter  resolution  everywhere. 


2.  Less  data  are  transferred  from  discs  to  high-speed  memory 
each  frame  time  (compared  to  the  perspective-storage 
algorithm) . 

3.  Real-time  subdivision  is  fractal  only;  the  absence  of 
bicubic  subdivision  decreases  hardware  costs  and  computation 
time. 


4.  Because  subdivision  occurs  during  real  time,  full  resolution 
is  obtained  for  all  parts  of  the  terrain  displayed  on  the 
screen . 


Disadvantages 


1.  Under  best-case  conditions,  the  terrain  will  be  essentially 
flat  and  the  sun  at  a  high  altitude.  Under  worst-case 
conditions,  the  terrain  will  be  hilly  or  mountainous  and  the 
sun  will  be  at  a  low  altitude.  In  such  a  case,  many  patches 
will  have  to  be  off-line  subdivided  very  finely  (=2  meters). 
Thus,  the  situation  goes  back  to  very  high  data  storage  and 
transfer  problems.  Since  this  worst  case  cannot  be  effectively 
dealt  with,  the  algorithm  should  not  be  implemented. 
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Ufc.RiVATj.GN  OF  Tht  NUMBER  UP  BICUBIC  SUBDIVISIONS 


Eacn  terrain  or  cultural  object  surface  patch  that  falls  within  the 
ouserver's  field  of  view  iFOV)  is  projectea  to  his/her  screen  ana 
suuuivicea  until  each  suopatch  is  no  larger  than  a  pixel.  The  number 
or  suDoivisions  required  oepenas  on  how  the  terrain  projects  to  the 
screen,  that  is,  it  oepenas  on  terrain  roughness  anu  orientation. 

m  terrain  mouei  is  oescnoeo  oeiow  in  which  roughness  is  quantified, 
in  auoition,  equations  are  aenvea  for  the  projectea  areas  of  single 
paccnes  ana  their  distributions.  These  equations  are  combineo  to 
provide  the  totai  projectea  area  of  terrain  hiuaen  ana  visible 
surfaces  on  tne  screen.  From  this,  the  number  of  bicubic  suboi visions 
per  frame  in  a  "mooerately  oao"  case  is  estimateo. 

The  first  step  is  to  oenve  a  key  relationship  between  the  orientation 
of  a  patch,  relative  position  of  the  observer,  ana  the  projectea  area 
of  a  paten  at  the  screen.  Much  of  the  further  analysis  is  baseo  on 
tins  relationship. 

Tne  imaging  geometry  is  shown  in  Figure  £-1.  The  patch  is 
approximately  at  a  Distance  n  from  the  observer  (who  is  in  the  C  - 
n  plane).  The  ooserver  is  at  height  C  relative  to  the  patch.  The 
normal  to  tne  patch  makes  an  angle  Q  with  the  vertical,  and  its 
projection  on  the  Sp  plane  makes  an  angle  p  with  the  §  axis 
(.cylindrical  notation).  The  iine-of-sight  makes  an  angle  &  with  the 
horizontal.  The  patch  size  is  h  x  h. 
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For  a  flat  terrain,  the  projected  area  of  the  patch  in  angular 
suotense  at  the  screen  is  given  by: 

h2  9 

Area  =  -j-  cos  A  rad  (E-l) 

where  A  is  the  angle  made  by  the  line-of-sight  vector  l  with  the 
patch  normal  "FT! 

Now,  cos  A  =  i  •  n  where: 

l  =  [cos  8,  0,  sin  8] 

ana  rT  =  [sin  0  cos  <j>,  sin  0  sin  <}>,  cos  Or 

Then: 

cos  A  =  [sin  8  cos  0  +  cos  8  sin  0  cos  <J>]. 

Substituting  (-2  into  -1): 

h2 

Area  =  — [sin  8  cos  0  +•  cos  8  cos  d>]  (E- 3) 

For  small  8,  the  observation  angle  can  be  approximated  by: 
sin  6  =  C/n 
cos  8=1 

Similarly,  sin  0  =  0  and  cos  0=1  for  small  0. 

Hence  the  area  of  the  patch  becomes: 


Area  =  jjz —  +  0  cos  <^J  (rad  )2  (E-4) 

Equation  (E-4)  gives  the  projected  area  of  a  patch  at  a  specific  tilt 
orientation  (0,  4>) »  distance  n»  and  relative  height  £  from  the 
observer .  In  practice,  of  course,  patches  can  have  different  tilts 
0,  orientations  <p,  and  heights  6  with  respect  to  the  observer. 

Hence,  to  find  the  average  projected  area  of  a  patch  at  a  given 
distance,  statistical  models  of  the  parameters  0,  <j>,  and  C  have  to 
be  generated.  This  statistical  model  gives  rise  to  a  means  of 
characterizing  the  terrain  roughness. 

TERRAIN  ROUGHNESS  MOOEL 

The  terrain  is  composed  of  square  patches  (of  side  h)  each  with  an 
angle  0  to  the  vertical,  an  angle  <j>  to  the  vertical  plane 
containing  the  patch  and  the  observer,  and  heights  below  the  observer 
(Figure  E-l) .  Note  that  0  denotes  whether  a  patch  is  tilted  and  * 
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aeternines  whether  it  is  tiltea  toward  or  away  from  the  observer.  The 
following  assumptions  can  be  maae  about  the  distribution  of  •?,  <j> 
ana  £  over  the  entire  FOV: 

o  9,  <)>  ana  5  are  independent  random  variables 

o  9,  *  and  C,  are  stationary  processes  in  the  FOV;  that  is, 

the  distribution  of  the  parameters  is  not  a  function  of  the 
location 

It  can  be  further  assumed  that  <t  is  uniformly  distributed  between  0 
ana  2tt.  This  means  it  is  equally  likely  that  the  observer  is 
looking  at  a  patch  from  any  direction  of  the  compass.  The 
distribution  of  9,  the  tilt  of  a  patch  to  the  vertical,  need  not  be 
completely  specified.  It  is  completely  characterized  for  purposes  of 
this  analysis  by  its  mean  value  0m.  Finally,  C>  is  assumed  to  be  a 
normal  ranaom  variable  with  mean  me  and  standard  deviation  o  C» 
m?  and  oc  are  measured  over  the  significant  region  of  the  FOV. 

The  terrain  roughness  is  then  completely  characterized  by  the 
average  slope  of  a  patch,  and  oC,  the  standard  deviation  of  the 
patch  elevations  over  a  small  area.  Figures  E-2  through  E-5  provide 
empirical  data  showing  the  distribution  of  tilts  and  altitudes  of 
representative  terrain. 

THE  AVERAGE  AREA  OF  A  PATCH  AT  DISTANCE  X 


From  the  terrain  roughness  model,  the  average  area  of  a  patch  in 
Equation  (E-4)  is  computed  by  integrating  over  the  distributions  of 
0,  <t>,  and  C,  .  Since  these  parameters  are  assumed  to  be 
independent,  the  order  of  integration  is  immaterial. 


The  result  in  Equation  (E-4)  is  first  averaged  over  all  possible 
orientations  of  the  observer  with  respect  to  the  patch.  Since  each 
orientation  <j>  is  equally  likely,  the  probability  density  of  <|>  is: 


P(<t>) 


2tt 


0  <  <J>  <  2tt 
0  elsewhere 


(E-5) 


Since  the  "back”  of  a  patch  must  be  subdivided  if  it  is  visible, 
negative  areas  (of  a  patch  facing  away  from  observer)  should  be 
counted  as  positive  areas.  Therefore,  the  average  over  $  should  be 
written: 


where  i 


r,2  L" 


E,  [area]  =  E  I  T  +  0  cos 

<p 

i  denotes  absolute  value  and  E  [  ]  denotes  expected  value  or 


<b 


( E— 6 ) 


average. 
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histogram  of  patch  tilts. 


PATCH  ALTITUDE 


Histogram  of  patch  aitituoes. 


Note  cnat  c.s  p  vanes  f  lom  0  tc  1,  cos  t>  tsKcs  on  values  from 
Octween  +i  ano  -1.  Tnerefore,  me  aoove  quantity  is  Difficult  to 
evaluate  in  ciosec  form  umess  tne  specific  value  of  £/n  is  known. 
xnsteaG,  Schwartz's  inequality  gives: 


/  n 

c<p  t-area  J  —  ~ 


hr)  +  S  C0  cos  * 


] 


CE-7) 


mich  gives  an  upper  uouno  (conservative  estimate)  on  the  area. 


„  tr/2 

Now:  0  £  lCos  <t>j 

0 


hence:  E,  Lareaj 


Since  this  equation  is  linear  in  0,  averaging  over  all  possible  9 
ano  assuming  0  has  a  mean  value  of  0m  gives: 

E.  Lareaj  =  1  £  I  +  |  0  (rao2)  =  A  (E-10) 

<p  U  /  TT  m 

n  n 

Note  that  the  first  term  in  the  above  equation  corresponas  to  the  fiat 
earth  case.  The  secona  term  maaifies  the  result  for  a  rough  terrain. 

DISTRIBUTION  OF  PATCH  PROJECTED  AREAS 

Equation  (E-10)  gave  the  average  projected  area  of  a  patch  at  a 
aistance  n  ano  relative  height  C  from  the  sensor.  To  compute  the 
total  projecteo  area  at  the  screen  oue  to  all  the  patches  in  the  FOV, 
the  attribution  of  the  patch  distances  must  be  Determined;  that  is, 
how  many  patches  are  at  a  given  aistance  from  the  observer.  The 

numoer  of  patches  in  the  strip  on  at  a  aistance  n  is  given  by: 

p(n)dn  =  -3-  dn  (E-ll) 

h2  H 

The  total  projected  area  is  obtained  by  integrating  (E-10)  ano  (E-ll) 
over  tne  near  ana  far  aistances  in  the  FOV,  that  is: 


=  9  •  /  cos  (pod) 

z  -ir/2 


(E-8) 


I0 


=  £=-  1  C  1  +  D_  •  4  Qz(raa  ) 


(E-5) 
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Tnen  Equation  (E-13)  Decomes: 


A  -  -4Jy 


r  3 

c  m  /  z  \ 

y  ' '  \  '  vJ_ 


lE-i4] 


assuming  an  n  x  n 
area  in  numoer 


element  raster  over  tne  FuV  (iiv 
of  raster  elements  is  given 


Dy : 


tne 


A  =  n 


1  +  4 


0  fl  \“] 

*  •  y 


(E-15) 


Equation  kt-i5)  explicitly  snows  tne  total  projecteo  area  for  a  rough  terrain 
wnen  tne  entire  FOV  is  covereo  „witn  tne  grounc  patches,  in  tne  fiat  earth 
case,  it  is  oovious  that  A  =  n2,  which  is  intuitively  correct.  With  rough 
terrain  t,Qm  >  0) ,  because  of  hiauen  surfaces  more  tnan  one  point  on  the 
giouno  maps  to  the  same  point  on  the  screen.  This  is  the  reason  why  tne  total 
projecteo  area  can  oe  greater  tnan  n2  raster  elements.  To  see  how  rougn 
terrain  affects  tne  quantity  in  Equation  (E-13),  assume  £j_  =  500m, 

2. 2  =  10  km,  ano  a  vertical  FOV  <i>v  =  30°.  Taoie  E-i  snows  the  total 
projecteo  area  as  a  function  of  0m,  the  roughness  parameter. 


Taoie  E-i  shows  that  for  0m  =  15  (extremely  rough  mountain  terrain)  the 
totai  projecteo  area  is  2.27  times  the  corresponaing  result  for  tne  fiat  earth 
case  oecause  of  hioaen  surfaces. 


TABLE  E-l. 


AREA  VS 


0° 

fll 

A/n2 

0 

1 

2 

1.16 

5 

1.39 

7.5 

1.59 

10 

1.78 

12 

1.94 

15 

2.27 
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bote  tnat  the  projected  area  A  =  nzL2.27]  is  a  worst  case  in  two 
ways.  First,  3m  =  15°,  which  is  quite  rough.  Secona,  the 
screen  top  eage  is  set  to  coinciae  with  the  horizon.  This  ensures 
tnat  the  projecteo  scene  contains  no  sky  (tne  sky  is  not  subai video) 
uut  that  tne  orientation  is  as  nearly  horizontal  as  possible,  to 
maximize  the  numoer  of  hidden  surfaces. 

Empirical  tests  of  the  number  of  four-way  subdivisions  required  per 
unit  area  of  a  typical  projecteo  patch  oemonstrateo  tnat  there  were 
ion  tne  average)  0.75  suooivisions  per  unit  area.  This  number 
xnciuues  ail  levels  of  suboivisions  for  a  patch. 

Thus,  tne  total  numoer  of  suboivisions  is  0.75  x  2.27  nz  =  1.7  x 
iO°/f  rame. 


Note  that  each  suoaivision  proouces  four  subpatches,  so  that  each 
frame  we  must  deal  with  approximately  4  x  1.7  x  10°  =  6.8  x  106 
subpatches. 
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